Original Article

Development and Evaluation of a Turkish Scale to Assess Medication Literacy for Adults

10.4274/tjps.galenos.2022.07277

  • Ozgenur TORUN
  • İlkay MEMİÇ
  • Pınar AY
  • Mesut SANCAR
  • Aysu SELCUK
  • Ecehan BALTA
  • Vildan OZCAN
  • Betul OKUYAN

Received Date: 24.03.2022 Accepted Date: 05.05.2022 Turk J Pharm Sci 2023;20(2):84-90 PMID: 37161381

Objectives:

This study aimed to develop a Turkish scale to assess medication literacy and to evaluate its psychometric properties among adults having at least 12 years of education in Türkiye.

Materials and Methods:

After the composition of a preliminary set of items, the content validity of the scale was assessed by an e-Delphi process and a pilot study. The psychometric properties of the scale were evaluated in 358 participants, who had above 12 years of education: university students, academics and, administrative staff from two faculties (pharmacy and law) in two universities located in two major cities (İstanbul and Ankara) in Türkiye between March and May, 2021. The test-retest validity was assessed by Spearman’s rho and Wilcoxon test. Internal consistency was evaluated by Kuder Richardson 20. Principal component analysis was conducted.

Results:

The last version of the medication literacy scale consisted of 8 items. There was a positive correlation (Spearman’s rho: 0.570; p<0.01) and no significant difference (p=0.308) between the scores of the scale at baseline and after a two-week interval. Kuder Richardson 20 coefficient was 0.659. Students and graduates of health sciences and participants with high reading ability of health-related information had significantly higher scores on the medication literacy scale (p<0.001).

Conclusion:

Turkish version of the Medication Literacy Scale for Adults is a valid tool for evaluate medication literacy among adults, who have above 12 years of education in Türkiye. The generalizability of our findings should be evaluated with caution since this study was conducted in a sample with a significant representation from healthcare professionals. It would be useful to conduct further studies evaluating the psychometric properties of this scale in participants with diverse characteristics.

Keywords: Medication literacy, scale, clinical pharmacy, validation, measure, health literacy

INTRODUCTION

Medication literacy is defined as “the degree to which individuals can obtain, comprehend, communicate, calculate, and process patient-specific information about their medications to make informed medication and health decisions in order to safely and effectively use their medications, regardless of the mode by which the content is delivered (e.g., written, oral, and visual)”.1

Medication literacy is essential for enabling individuals to safely use unprescribed medications, herbal products, and dietary supplements in addition to the prescribed medications.2 Individuals with poor medication literacy could improperly manage their medications, leading to medication-related problems, including medication adherence.3 Promoting individuals’ capability toward rationale medication use is crucial to avoiding potential medication-related problems.

A medication literacy scale, which is designed to evaluate the counseling and educational needs of healthy individuals in primary care (such as community pharmacies) and clinical settings, should be valid and reliable as well as not time-consuming and easily applicable. Worldwide, there are only a few specific tools or scales for measuring medication literacy.4,5 The Recognition and Addressing of Limited Pharmaceutical Literacy (RALPH), developed by Vervloet et al.6, is an interview guide for pharmacists in identifying the individuals with limited medication literacy implicitly. RALPH interview guide determines medication literacy by asking questions about the medications used by the patient. However, this scale is not applicable to healthy individuals, who do not use medication regularly.7 There are also scales that are constructed based on vignette scenarios and medication leaflets and instructions.2,8,9,10 Vignette-based questions with instructions assess individuals’ understanding and interpretation of medication information. However, vignette-based scales are mostly composed of questions specific to the health system of the country, where the scale had been developed,2,8 so, they are not suitable for cultural adaption.

In Türkiye, more than half of the adults have inadequate or limited health literacy levels. This problem is clear also among participants who are university graduates and/or who have a higher educational level (https://sggm.saglik.gov.tr/Eklenti/39699/0/soya-rapor-1pdf.pdf) Accessed date: 1 April 2022. Still, there is currently no Turkish scale to evaluate individuals’ medication literacy levels.

This study aimed to develop a scale of medication literacy in Turkish [Medication Literacy Scale for Adults (MELSA-TR)] and evaluate its psychometric properties among adults having at least 12 years of education (including Turkish university students, academics, and administrative staff) in Türkiye.


MATERIALS AND METHODS


Ethical approval

Ethical approval for this study was received from Marmara University, Institute of Health Science Ethical Board Committee, İstanbul, Türkiye (date: 14/09/2020; file number: 77). Participants were provided electronic informed consent to participate in the study.

The study was reported on the basis of the recommendations of the consensus-based standards for selecting health status measurement instruments (COSMIN) statement.11 The study design is presented in Figure 1.


Composition of a preliminary set of items

The scale items were developed considering the literature.2,9,12,13 The research team also reviewed drug leaflets and patient education brochures to generate the items. As the first version of MELSA-TR, twenty-seven draft items were created using virtual medicine boxes and instructions. Both performance-based (such as calculation) and perception-based (interpretation of instructions given) items related to the prescribed medications/non-prescribed medications/dietary supplements/herbal medicines were included. These items were created based on numeracy, prose, and document literacy.2 Each item of the scale had a dichotomous score (1: for the correct response and 0: for the wrong response and the option of no idea/don’t know).


e-Delphi process

The content validity of the scale was assessed by an e-Delphi process between December 2020 and February 2021. A national multidisciplinary group of experts working on health literacy (including community pharmacists, hospital pharmacists, a health sociologist, a clinical psychologist, a public health expert, nurses, a pharmacologist, clinical pharmacists, physicians, a pedagogist, and an education specialist) participated in the e-Delphi process. A link to the online survey was generated on the Marmara University Questionnaire System, which is powered by the Lime Survey©, and invitation letters were sent to the experts by email. After receiving their informed consent electronically, the questionnaire link was sent individually with a password. The participants were asked to complete the questionnaire within three weeks.

The experts were asked whether the items would be relevant to medication literacy. The experts rated each item with a 4-point Likert scale [from very irrelevant (1) to very relevant (4)] and provided suggestions and comments to evaluate the clarity and comprehensibility of the questions (about the type, visual, and grammar of the items) by filling in the comment box for each item. At the end of each round, the content validity ratio (CVR) and the content validity index (CVI) were calculated for each item.14 If the item-CVI was less than 0.70, the item was excluded from the scale. If the item CVI was in the range of 0.70-0.79, it was revised. If CVR value of the item was negative, it was excluded from the scale.15

Two separate rounds were conducted within four weeks intervals for the e-Delphi study. Thirty-six experts from various disciplines were invited to the e-Delphi study. Thirty experts participated in round 1. At the end of round 1, four items in the scale were excluded based on the CVR and CVI findings. The items were re-written according to the feedback and suggestions of the experts. Twenty-six experts participated in round 2. No items were excluded and no other items were added to the scale in round 2, while the second version of MELSA-TR consisted of 23 items.


Pilot study

A pilot study was conducted on 30 adults (a separate sample of individuals who were recruited neither in the test-retest nor the psychometric study) for the second version of MELSA-TR. The participants assessed the comprehensibility of the items. It took an average of 10-15 minutes to complete the scale. The readability of the total scale was evaluated by the Turkish evaluation formula, which was developed by Ateşman16 and it was found to be average, with a score of 65.3.


Assessment of the psychometric properties of the scale

An online survey was conducted between March and May, 2021. The sample size for validation studies is recommended to be ten times the number of items in the scale, so it was calculated that at least 300 participants would be required for an adequate sample size.17 The study population consisted of university students, academics, and administrative staff from two faculties (pharmacy and law) in two universities located in two cities (İstanbul and Ankara) in Türkiye. Because of the restrictions (including a curfew and social distance) during the coronavirus disease-2019 (COVID-19) pandemic, an online survey was conducted in both Delphi processes and the psychometric analysis. Due to the difficulties in reaching individuals with low education levels, this study was conducted only on individuals with an education level of above 12 years using convenience sampling. In Türkiye, the compulsory education year has been 12 since 2012 (https://www.resmigazete.gov.tr/eskiler/2012/04/20120411-8.htm Accessed date: 1 February 2022). The population of this study had a medium to high level of education according to the International Standard Classification of Education (https://ec.europa.eu/eurostat/statistics-explained/index.php?title=International_Standard_Classification_of_Education_(ISCED)#Implementation_of_ISCED_2011_.28levels_of_education.29 Accessed date: 1 February 2022).

Socio-demographic variables [age, sex, faculty, and degree (year), having a bachelor’s degree or associate degree in health sciences for academic and administrative staff, perceived socioeconomic status, use of prescribed medication/unprescribed medication/vitamin, and perceived general health assessment] were collected.

Turkish version of the Single Item Literacy Screener developed by Morris et al.18 was used to evaluate the need for individuals for reading and comprehension of health-related materials. The item was as follows: “How often do you need someone to help you, when you read instructions, pamphlets, or other written material from your doctor or pharmacy?”. A 5-Likert scale (ranging from never to always) was used in this self-report instrument, and the cut-off was greater than 2 to identify subjects with limited reading ability for health-related information.

Two-week test-retest reliability for the second and final versions of MELSA-TR was evaluated on 30 participants (a separate sample of individuals who were recruited neither in the test-retest nor the psychometric study). The discrimination index (which was considered as excellent if it was greater than 0.4) and the difficulty index (which is considered as difficult if it was less than 30%) were calculated.19

Kuder Richardson 20 coefficient was calculated to determine the internal consistency of the scale. A shorter and more reliable version of the scale with 8 items was created taking into consideration the discrimination index, the difficulty index, and Kuder Richardson 20 coefficient. Principal component analysis was conducted.

The following hypothesis was tested to evaluate the construct validity of the scale: Students (fourth and fifth-grade students of faculty of pharmacy) and graduates (academic and administrative staff with bachelor’s degree or associate degree in health science) of health science have higher scores on the medication literacy scale compared with participants who did not have any education in health sciences. The study was conducted among all university students, regardless of their grades. However, the hypothesis was restricted to only the fourth and fifth-grade students of the faculty of pharmacy because the pharmacy students have been receiving professional pharmacy courses in these grades according to the national pharmacy core education program in Türkiye (https://www.yok.gov.tr/Documents/Kurumsal/egitim_ogretim_dairesi/Ulusal-cekirdek-egitimi-programlari/eczacilik_cep.pdf Accessed date: 1 February 2022).


Statistical analysis

Descriptive data were presented as medians (25th-75th percentiles) and numbers (percentages), where appropriate. Kolmogorov-Smirnov test was used to assess the normality of the data. Since the data did not follow a normal distribution, continuous variables for two and more than two groups were compared with Mann-Whitney U and Kruskal-Wallis tests, respectively. Kuder Richardson 20 coefficient was calculated to determine internal consistency. Principal component analysis was conducted. Spearman’s correlation and Wilcoxon test were used to evaluate test-retest reliability. P<0.05 was set as the level of statistical significance. Data analysis was performed by IBM® SPSS® 11 software.


RESULTS

The online survey link was accessed by 752 participants. Fourteen participants declined to participate. Three hundred eighty participants did not complete the survey. Therefore, 358 of 752 (47.6%) were included in the analysis. The median (25th-75th percentiles] age was 22 (21-24) years (minimum-maximum: 19-62). The characteristics of the participants (n: 358) are presented in Table 1.

For the final version of MELSA-TR, the test-retest reliability (n: 30) showed a positive correlation between the scores of the scale at baseline and after a two-week interval (Spearman’s rho: 0.570; p<0.01). There was no significant difference between the test and retest scores (p=0.308) (data not shown).

Kuder Richardson 20 coefficient was 0.762 for the second version of MELSA-TR. The final version was limited to 8 items taking into consideration the content of the items, discrimination index, the difficulty index, and Kuder Richardson 20 coefficient. Kuder Richardson 20 coefficient was 0.659 for the final version consisting of 8 items. The median (25th-75th percentiles) score of the scale was 8.0 (7.0-8.0). Kaiser-Meyer-Olkin Measure of Sampling Adequacy was 0.776 with Bartlett’s Test of Sphericity was significant (p<0.001). Only one factor was extracted by principal component analysis. The content of the items, the proportion of correct responses, corrected item-total correlation, and Kuder Richardson 20 coefficient if item deleted for each item are presented in Table 2.

Students (fourth and fifth-grade students of faculty of pharmacy) and graduates (academic and administrative staff with bachelor’s degrees or associate degrees in health science) of health science had significantly higher scores on the medication literacy scale compared with the participants who did not have any education on health sciences [the median (25th-75th percentiles): 8.0 (8.0-8.0) vs. 7.0 (6.0-8.0), respectively; p<0.001]. Female participants had significantly higher scores on medication literacy scale compared with the males [the median (25th-75th percentiles): 8.0 (7.0-8.0) vs. 7.0 (6.0-8.0), respectively; p=0.001]. Participants with the high reading ability of health-related information had significantly higher scores on the medication literacy scale compared with those having the limited reading ability [the median (25th-75th percentiles): 8.0 (7.0-8.0) vs. 7.0 (6.0-8.0), respectively; p=0.002]. Medication literacy scale scores by participants’ characteristics are presented in Table 3.


DISCUSSION

Content validity, the test-retest validity, internal consistency, and construct validity of MELSA-TR were confirmed in this study. Like the previously developed medication literacy scales,2,8,10 Kuder Richardson 20 coefficient of MELSA-TR was determined as 0.659 and acceptable. Therefore, we suggest that MELSA-TR is a valid tool for adults having at least 12 years of education. However, we used a sample with a significant representation from healthcare professionals so the generalizability of our findings for adults with a medium to high level of education should be evaluated with caution. It would be useful to conduct further studies evaluating the psychometric properties of this scale in participants with diverse characteristics.

Like similar medication literacy scales,2,8,9,10 our scale consisted of numeracy questions (including calculation of dose and refill prescription date) items related to prose and document literacy. Neiva Pantuzza et al.5 defined four constructs of medication literacy: functional literacy, communicative literacy, critical literacy, and numeracy. The items in MELSA-TR had items to assess all these constructs. During the COVID-19 pandemic, an infodemic had arisen,20 so, we included two items related to critical and communicative literacy about the news on social media/television and purchasing herbal medicine on the internet, the advice taken from relatives/friends, and communication with physicians/pharmacists.


Study limitations

We used an online survey to determine the psychometric properties of the scale due to COVID-19 pandemic, which might have resulted with a selection bias. The participants who used the internet more frequently and/or were more interested in medication information might have participated more, resulting with an overestimation of total scores. Also, in an online survey, the participants might have gotten some guidance in filling out the questionnaire. The participants were adults with medium to high level of education who had worked and/or studied at universities, and some of them were health science students and/or professionals, which also limit the generalizability of the findings.

CONCLUSION

MELSA-TR could be used to evaluate the medication literacy levels of adults having at least 12 years of education in Türkiye. There is still a need to test the psychometric properties of the scale on diverse populations, particularly on socioeconomic disadvantaged groups, before using it extensively. This scale has many advantages, such as being a self-reported, valid, easily applicable, and not time-consuming tool. It also does not consist of items related to the country-based healthcare system. Still, we note that further studies among participants with diverse characteristics (particularly on socioeconomic disadvantaged groups) would be useful for evaluating psychometric properties in more detail.


Ethics

Ethics Committee Approval: Ethical approval for this study was received from Marmara University, Institute of Health Science Ethical Board Committee, İstanbul, Türkiye (date: 14/09/2020; file number: 77).

Informed Consent: Participants provided electronic informed consent to participate in the study.

Peer-review: Externally peer-reviewed.

Authorship Contributions

Concept: O.T., İ.M., P.A., M.S., B.O., Design: O.T., İ.M., P.A., M.S., B.O., Data Collection or Processing: O.T., İ.M., A.S., E.B., V.O., B.O., Analysis or Interpretation: O.T., İ.M., P.A., M.S., A.S., E.B., V.O., B.O., Literature Search: O.T., İ.M., P.A., M.S., B.O., Writing: O.T., İ.M., P.A., M.S., A.S., E.B., V.O., B.O.

Conflict of Interest: No conflict of interest was declared by the authors.

Financial Disclosure: The project entitled “A Scale Development Study to Determine Individuals’ Medication Literacy, and Attitudes Regarding Rational Medication Use” was supported by the TÜBİTAK 2209-A program (no: 1919B012001763).

Images

  1. Pouliot A, Vaillancourt R, Stacey D, Suter P. Defining and identifying concepts of medication literacy: an international perspective. Res Social Adm Pharm. 2018;14:797-804.
  2. Sauceda JA, Loya AM, Sias JJ, Taylor T, Wiebe JS, Rivera JO. Medication literacy in Spanish and English: psychometric evaluation of a new assessment tool. J Am Pharm Assoc (2003). 2012;52:e231-e240.
  3. Koster ES, Philbert D, van Dijk L, Rademakers J, de Smet PAGM, Bouvy ML, Vervloet M. Recognizing pharmaceutical illiteracy in community pharmacy: agreement between a practice-based interview guide and questionnaire based assessment. Res Social Adm Pharm. 2018;14:812-816.
  4. Gentizon J, Hirt J, Jaques C, Lang PO, Mabire C. Instruments assessing medication literacy in adult recipients of care: a systematic review of measurement properties. Int J Nurs Stud. 2021;113:103785.
  5. Neiva Pantuzza LL, Nascimento ED, Crepalde-Ribeiro K, Botelho SF, Parreiras Martins MA, Camila de Souza Groia Veloso R, Gonzaga do Nascimento MM, Vieira LB, Moreira Reis AM. Medication literacy: a conceptual model. Res Social Adm Pharm. 2022;18:2675-2682.
  6. Vervloet M, van Dijk L, Rademakers JJDJM, Bouvy ML, De Smet PAGM, Philbert D, Koster ES. Recognizing and addressing limited pharmaceutical literacy: development of the RALPH interview guide. Res Social Adm Pharm. 2018;14:805-811.
  7. Zheng F, Ding S, Lai L, Liu X, Duan Y, Shi S, Zhong Z. Relationship between medication literacy and medication adherence in inpatients with coronary heart disease in Changsha, China. Front Pharmacol. 2020;10:1537.
  8. Yeh YC, Lin HW, Chang EH, Huang YM, Chen YC, Wang CY, Liu JW, Ko Y. Development and validation of a Chinese medication literacy measure. Health Expect. 2017;20:1296-1301.
  9. Stilley CS, Terhorst L, Flynn WB, Fiore RM, Stimer ED. Medication health literacy measure: development and psychometric properties. J Nurs Meas. 2014;22:213-222.
  10. Horvat N, Kos M. Development, validation and performance of a newly designed tool to evaluate functional medication literacy in Slovenia. Int J Clin Pharm. 2020;42:1490-1498.
  11. Gagnier JJ, Lai J, Mokkink LB, Terwee CB. COSMIN reporting guideline for studies on measurement properties of patient-reported outcome measures. Qual Life Res. 2021;30:2197-2218.
  12. Ubavić S, Krajnović D, Bogavac-Stanojević N. Pharmacotherapy literacy questionnaire for parents of pre-school children in Serbia: construction and psychometric characteristics. Vojnosanitetski Pregled. 2019;76:1054-1061.
  13. Kripalani S, Henderson LE, Jacobson TA, Vaccarino V. Medication use among inner-city patients after hospital discharge: patient-reported barriers and solutions. Mayo Clin Proc. 2008;83:529-535.
  14. Lawshe CH. A quantitative approach to content validity 1. Personnel Psychology. 1975;28:563-75.
  15. Rodrigues IB, Adachi JD, Beattie KA, MacDermid JC. Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskelet Disord. 2017;18:540.
  16. Ateşman E. Measuring readability in Turkish. AU Tömer Language Journal. 1997;58:171-174.
  17. Streiner DL, Kottner J. Recommendations for reporting the results of studies of instrument and scale development and testing. J Adv Nurs. 2014;70:1970-1979.
  18. Morris NS, MacLean CD, Chew LD, Littenberg B. The Single Item Literacy Screener: evaluation of a brief instrument to identify limited reading ability. BMC Fam Pract. 2006;7:21.
  19. Mitra N, Nagaraja H, Ponnudurai G, Judson J. The levels of difficulty and discrimination indices in type A multiple choice questions of pre-clinical semester 1 multidisciplinary summative tests. IeJSME. 2009;3:2-7.
  20. The Lancet Infectious Diseases. The COVID-19 infodemic. Lancet Infect Dis. 2020;20:875.