The Karma system is currently undergoing maintenance (Monday, January 29, 2018).
The maintenance period has been extended to 8PM EST.

Karma Credits will not be available for redeeming during maintenance.
Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 18.07.17 in Vol 19, No 7 (2017): July

This paper is in the following e-collection/theme issue:

    Original Paper

    Readability of Wikipedia Pages on Autoimmune Disorders: Systematic Quantitative Assessment

    1Department of Medicine B, Sheba Medical Centre, Tel Aviv, Israel

    2Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel

    3Zabludowicz Center for Autoimmune Diseases, Sheba Medical Centre, Tel Aviv, Israel

    4Department of Health Sciences, University of Genoa, Genoa, Italy

    5Department of Neuroscience, University of Verona, Verona, Italy

    6Leeds Institute of Rheumatic and Musculoskeletal Medicine, University of Leeds, Leeds, United Kingdom

    7Bar-Ilan Faculty of Medicine, Padeh and Ziv Hospitals, Zefat, Israel

    Corresponding Author:

    Abdulla Watad, MD

    Department of Medicine B

    Sheba Medical Centre

    Tel-Hashomer, 52621

    Tel Aviv,

    Israel

    Phone: 972 3 530 2435

    Fax:972 3 535 4796

    Email:


    ABSTRACT

    Background: In the era of new information and communication technologies, the Internet is being increasingly accessed for health-related information. Indeed, recently published patient surveys of people with autoimmune disorders confirmed that the Internet was reported as one of the most important health information sources. Wikipedia, a free online encyclopedia launched in 2001, is generally one of the most visited websites worldwide and is often consulted for health-related information.

    Objective: The main objective of this investigation was to quantitatively assess whether the Wikipedia pages related to autoimmune disorders can be easily accessed by patients and their families, in terms of readability.

    Methods: We obtained and downloaded a list of autoimmune disorders from the American Autoimmune Related Diseases Association (AARDA) website. We analyzed Wikipedia articles for their overall level of readability with 6 different quantitative readability scales: (1) the Flesch Reading Ease, (2) the Gunning Fog Index, (3) the Coleman-Liau Index, (4) the Flesch-Kincaid Grade Level, (5) the Automated Readability Index (ARI), and (6) the Simple Measure of Gobbledygook (SMOG). Further, we investigated the correlation between readability and clinical, pathological, and epidemiological parameters. Moreover, each Wikipedia analysis was assessed according to its content, breaking down the readability indices by main topic of each part (namely, pathogenesis, treatment, diagnosis, and prognosis plus a section containing paragraphs not falling into any of the previous categories).

    Results: We retrieved 134 diseases from the AARDA website. The Flesch Reading Ease yielded a mean score of 24.34 (SD 10.73), indicating that the sites were very difficult to read and best understood by university graduates, while mean Gunning Fog Index and ARI scores were 16.87 (SD 2.03) and 14.06 (SD 2.12), respectively. The Coleman-Liau Index and the Flesch-Kincaid Grade Level yielded mean scores of 14.48 (SD 1.57) and 14.86 (1.95), respectively, while the mean SMOG score was 15.38 (SD 1.37). All the readability indices confirmed that the sites were suitable for a university graduate reading level. We found no correlation between readability and clinical, pathological, and epidemiological parameters. Differences among the different sections of the Wikipedia pages were statistically significant.

    Conclusions: Wikipedia pages related to autoimmune disorders are characterized by a low level of readability. The onus is, therefore, on physicians and health authorities to improve the health literacy skills of patients and their families and to create, together with patients themselves, disease-specific readable sites, disseminating highly accessible health-related online information, in terms of both clarity and conciseness.

    J Med Internet Res 2017;19(7):e260

    doi:10.2196/jmir.8225

    KEYWORDS



    Introduction

    In the era of so-called eHealth, characterized by the spreading of new information and communication technologies, including the dynamic Web 2.0, every day millions of people surf the Internet as a source of health information [1-4]. They search for online material concerning the symptoms and clinical manifestation of a recently diagnosed disease, its possible management, the adverse effects of treatments, the details of diagnostic procedures, and its prognosis.

    Recent surveys conducted among patients with autoimmune disorders found the Internet to be one of the most important sources of health information on their condition [5]: YouTube, for example, is a source of information on rheumatoid arthritis, with a wide viewership and a potential to affect patients’ knowledge and attitudes [6]. Another study found that Web activities were influenced by the media coverage and publicity about a celebrity’s illness. In particular, the death of Harold Allen Ramis, a famous American actor, director, writer, and comedian, due to complications of an autoimmune inflammatory vasculitis, resulted in an increase in vasculitis-related Google searches, Wikipedia page accesses, and tweet production, peaking in February 2014 [7].

    The need for high-quality, accurate, but at the same time freely and easily accessible health care information on autoimmune disorders to better inform patients, their families, and the general population is of crucial and urgent importance, in that these disorders are characterized by a relevant societal and clinical burden [8]. The European Commission has acknowledged readability, that is to say the legibility of a written text and the ease with which a reader can understand and comprehend it, and accessibility as one of the 6 quality criteria of health-related websites [9].

    Since its launch in 2001, the free online encyclopedia Wikipedia has become the most popular general reference site on the Internet, and it is constantly accessed as a popular source of health care-related information. Wikipedia contains more than 30 million articles, which are available in up to 287 languages, including over 4.6 million English-language articles [10]. With the impressive figure of more than 18 billion page views and nearly 500 million unique visitors per month, the English version of Wikipedia ranks fifth in the list of most surfed websites worldwide [11].

    Noteworthy, most Wikipedia articles dedicated to autoimmune disorders rank first or among the first results in a Google search. As such, these articles are highly likely to be one of the most read and consulted sources of online information on autoimmune disorders for millions of English-speaking Internet users globally. The aim of this study was to quantitatively assess the readability of Wikipedia pages related to autoimmune disorders, using a systematic search strategy and validated readability instruments.


    Methods

    We obtained and downloaded a list of autoimmune disorders from the American Autoimmune Related Diseases Association (AARDA) website [12].

    For each autoimmune disorder, we retrieved and downloaded the corresponding Wikipedia page for further processing.

    In particular, we removed sections such as copyright information, references, and images from all pages. We analyzed Wikipedia articles for their overall level of readability using 6 different quantitative readability scales: (1) the Flesch Reading Ease, (2) the Gunning Fog Index, (3) the Coleman-Liau Index, (4) the Flesch-Kincaid Grade Level, (5) the Automated Readability Index (ARI), and (6) the Simple Measure of Gobbledygook (SMOG).

    Generally speaking, readability scores reflect parameters like sentence length, number of sentences, and the number of syllables or characters per word. Generally, polysyllabic words, long, complex sentences, and articulated paragraphs are penalized.

    In more detail, the Flesch Reading Ease readability index reports readability scores ranging from 0 to 100, with higher scores indicating a more easily accessible and readable text. Material with a score of 70 is usually considered to be appropriate for most adults, while text with a score between 30 and 50 is considered difficult to read, and text with a score between 50 and 60 is perceived as fairly difficult.

    The other 5 readability indexes—the Gunning Fog Index, the Coleman-Liau Index, the Flesch-Kincaid Grade Level, the ARI, and the SMOG—report a number that corresponds to an academic grade level (ie, to the number of years of formal education that a person would need in order to be able to understand the text easily on the first reading). The Gunning Fog Index is based on average sentence length and the number of complex words: a value less than 12 indicates a text that can be read and understood by a wide audience, being universally understandable if the value is less than 8. The Coleman-Liau Index is based on the average numbers of letters and the average number of sentences: a text whose score is less than 7 can be universally comprehended. The Flesch-Kincaid Grade Level relies on the average number of words and the average number of syllables: a text with a score of 7-8 is legible by a wide audience. The ARI is based on the average number of letters and the average number of words: a score less than 14 indicates a text understandable by a wide audience, while a value of 14 indicates a text that requires a university education. The SMOG is based on the average number of polysyllables and the average number of sentences: a commonly recommended grade level is in the range 7-8.

    Further, we analyzed eventual correlations between readability scores and epidemiological and clinical parameters of the autoimmune disorders under study. In particular, we investigated the following parameters: age at onset (≤20 years, 20-40 years, 40-60 years, 60-80 years); the incidence and prevalence figures according to the literature; clinical and pathological features (organ-specific vs systemic disease); and the McGonagle classification (classic polygenic autoimmune disease; polygenic autoinflammatory disease; mixed-pattern disease) [13]. We hypothesized that Wikipedia pages describing complex, unfamiliar, and less common diseases would be characterized by lower readability scores than would Wikipedia articles focusing on more common disorders. Further, since readability requires literacy skills, we expected a certain degree of correlation with onset age.

    We computed continuous data as mean (SD). For investigating the correlation between readability and clinical, pathological, and epidemiological parameters, we performed analysis of variance or Student t test as univariate analyses. For multivariate analysis, we carried out regression analyses.

    Further, we analyzed each Wikipedia page taking into account its different sections focusing on the following: pathogenesis of the disease (termed “pathogenesis”), management (termed “treatment”), diagnosis (termed “diagnosis”), and prognosis (termed “prognosis”). Paragraphs not falling into any of these categories were grouped in a section termed “other.”

    We conducted statistical analyses using the commercial software IBM SPSS version 23.0 (IBM Corporation). Graphs were generated using the commercial software MedCalc Statistical Software version 16.8.4 (MedCalc Software bvba).


    Results

    We retrieved 134 diseases from the AARDA website. Table 1 reports reading level assessments of the autoimmune disorder-related Wikipedia pages we analyzed. The mean Flesch Reading Ease score indicated that Wikipedia pages related to autoimmune disorders would require at least a university graduate school level, being very difficult to read and understand. The other readability scores suggested that overall readability corresponded to a 14th to 15th academic grade level. All the readability indices confirmed that the sites were suitable for a university graduate reading level (Table 1).

    Both univariate and multivariate analyses (Table 2,Figure 1, Figure 2, Figure 3, and Figure 4) demonstrated no correlation between readability scores and clinical parameters, epidemiological features of autoimmune disorders in terms of etiopathogenesis, incidence (common vs rare), and age of onset (0-20 years vs 20-40 years vs 40-60 years).

    Table 1. Readability scores of autoimmune disorder-related Wikipedia pages.
    View this table
    Table 2. Multivariate regression analysis of the readability scores for the autoimmunity disorder-related Wikipedia pages.
    View this table

    Table 3 shows readability indices broken down by section, and Multimedia Appendix 1 shows pairwise comparisons, corrected with Bonferroni correction for multiple comparisons. Statistically significant differences in readability indices were found among the different sections of the Wikipedia pages related to autoimmune disorders. In particular, considering the Flesch Reading Ease scores, the most readable sections concerned prognosis, while the least readable parts were the diagnostic paragraph(s). The prognostic sections differed from all the other parts, while the diagnostic sections did not differ from the parts on pathogenesis and management. Treatment sections were significantly different only from prognosis sections, while the sections on pathogenesis were significantly different from the prognosis and sections in the “other” category. Finally, these other sections differed from paragraph(s) concerning pathogenesis, diagnosis, and prognosis.

    We noted similar, consistent trends for the other readability indices (Table 3,Multimedia Appendix 1).

    Figure 1. Correlation between age (where 1 is 0-20 years, 2 is 20-40 years, 3 is 40-60 years, and 4 is 60-80 years) at onset of autoimmune diseases and the readability scores of their corresponding Wikipedia pages. Error bars indicate SD. ARI: Automated Readability Index, SMOG: Simple Measure of Gobbledygook.
    View this figure
    Table 3. Readability scores of autoimmunity disorder-related Wikipedia pages broken down by section.
    View this table
    Figure 2. Correlation between pathological characteristics (0=organ-specific, 1=systemic) of autoimmune diseases and the readability scores of their corresponding Wikipedia pages. Error bars indicate SD. ARI: Automated Readability Index, SMOG: Simple Measure of Gobbledygook.
    View this figure
    Figure 3. Correlation between the epidemiology of autoimmune diseases (0=not rare, 1=rare) and the readability scores of their corresponding Wikipedia pages. Error bars indicate SD. ARI: Automated Readability Index, SMOG: Simple Measure of Gobbledygook.
    View this figure
    Figure 4. Correlation between McGonagle classification of autoimmune diseases (1=classic polygenic autoimmune disease, 2=polygenic autoinflammatory disease, 3=mixed-pattern disease) and the readability scores of their corresponding Wikipedia pages. Error bars indicate SD. ARI: Automated Readability Index, SMOG: Simple Measure of Gobbledygook.
    View this figure

    Discussion

    Principal Findings

    To the best of our knowledge, this is the first systematic appraisal of the readability of autoimmune diseases-related Wikipedia material. In this investigation, we found that Wikipedia pages related to autoimmune disorders were characterized by a low level of readability, and this readability level was not correlated in any way with the clinical, pathological, and epidemiological characteristics of the disorders. In other words, the epidemiology (onset age, incidence, prevalence) and clinical presentation of the diseases were not reflected in the readability scores.

    Our findings of a low readability of Wikipedia pages are in line with the findings of other studies. In the extant literature, Azer et al [14] found that pages related to cardiovascular diseases were characterized by a readability score of 14.3 (SD 1.7) measured with the Flesch-Kincaid Grade Level, consistent with the readability level typical of university students. Candelario and colleagues, assessing medication guide-related Wikipedia pages, found that Wikipedia medication pages were characterized by a Flesch Reading Ease score of 52.93 and a Flesch-Kincaid Grade Level of 10.26, indicating that the Wikipedia pages were more difficult to read than their corresponding product medication guides [15]. Seth and coworkers [16] systematically investigated the readability of lymphedema-related online material and assessed 152 patient articles. They found an overall mean reading level of 12.6, with individual website reading levels ranging from 9.4 (cancer.org) to 16.7 (wikipedia.org). Interestingly, they noticed that online material describing conservative management differed from that reporting a surgical option in a statistically significant way (reading level of 12.7 vs 15.6, respectively, P<.001) [16]. Brigo and coworkers [17] computed the readability level of websites concerning epilepsy and obtained a difficult to fairly difficult readability level of 44.0±8.2, as measured with the Flesch Reading Ease instrument, with text readability corresponding to an 11th academic grade level (mean 11.3, SD 1.9). In particular, focusing on the Wikipedia pages, the average Flesch Reading Ease score was 25.6 (SD 9.5), with the other readability scales corresponding to a 14th grade level (mean 14.3, SD 1.7) [17]. Thomas et al [18] assessed the readability of Wikipedia pages related to renal diseases and found that they were written at a university reading level. Similar findings were obtained by other scholars. Tulbert and colleagues [19], in their analysis of dermatological online resources, compared 3 popular websites providing patient-education material (WebMD.com, Wikipedia.org, and MedicineOnline.com) versus the online material produced by the American Academy of Dermatology. Rajagopalan and coworkers [20], in their appraisal of patient-oriented cancer information on the Internet, compared Wikipedia with a professionally maintained database and found that the latter was more readable (Flesch-Kincaid Grade Level 14.1 vs 9.6, respectively). Azer [21] assessed 39 Wikipedia articles related to gastroenterology and hepatology and computed a mean overall readability score of 26 (SD 9.0) (range –8.0, SD 55.7 to 44.4, SD 1.4). Volsky and coauthors [22], in their analysis of pediatric otolaryngology online resources, compared Wikipedia, eMedicine, and MedlinePlus. They found that Wikipedia was the least readable resource. Brigo and Erro [23] analyzed the Wikipedia page related to Parkinson disease and found a low readability level (Flesch Reading Ease score 30.31).

    Very recently, a collateral Wikipedia project named Simple English Wikipedia has been developed and implemented with the aim of helping users to better read and understand uncommon, unfamiliar, or complex topics, by simplifying the Wikipedia articles. Pages written in simple English use fewer words and easier grammar than those written in standard English. Although generally aimed at students or children, Simple English Wikipedia may be helpful for people with low literacy skills, even though these pages are less accessed than those written in standard English. Therefore, the initiative of the Simple English Wikipedia should be further encouraged. For example, a direct link to it should be added in each corresponding standard English Wikipedia article, thus supporting and facilitating consultation of Simple English Wikipedia.

    Other similar ongoing projects include the WikiProject Epilepsy, specifically focused on epilepsy-related Wikipedia pages. Under the leadership of the International League Against Epilepsy and a committee of well-known scientists including Günter Krämer, Selim Benbadis, and Nicola Maggio, existing epilepsy-related entries are being critically revised and edited, and as well new entries are being created to provide the public with a comprehensive, clearly accessible database including both articles and video sequences of seizure episodes with commentary.

    Another project, a collaboration of the Imperial College School of Medicine (ICSM) and the WikiProject Medicine (the so-called ICSM Wikipedia Easter Project), aimed to bring together medical students and professors, librarians, and technologists in a 2-day competition to edit and provide updated content for a selected medical topic. However, this project, like the WikiProject University of California, was intended as a challenge rather than as a long-lasting initiative.

    Professionals working in the field of health care, helped by public and specialized libraries, as well as by other stakeholders, should make efforts to design or to bookmark online health-related material that, while preserving a high quality, accuracy, and exhaustiveness, can be easily read and understood [9].

    Moreover, a particular attempt should be made to simplify information on pathologies with a low incidence and prevalence and with a complex pathogenesis, also taking into account onset age, since the Internet presents a highly valued opportunity of supporting patients with rare autoimmune diseases [24].

    In the field of autoimmune diseases, to the best of our knowledge, no eHealth initiatives exist with the goal of improving the quality of disease-specific online material. Our study has contributed to drawing attention to the low readability content of autoimmune disease-related Wikipedia pages, emphasizing the urgent need to establish some forms of cooperation between doctors and patient groups working together to make easily accessible disease-specific websites and online materials.

    Conclusions

    This study addressed a topic currently neglected in the immunologic research field. While other medical fields have addressed the subject of Wikipedia readability (such as the neurological field), there is a dearth of similar studies in the specialties of immunology and autoimmunology. Our investigation was aimed at filling this gap in knowledge. Our findings underline the need for accessible and easily understandable online material dedicated to autoimmune disorders to further improve patients’ health literacy and awareness of their conditions. Even though readability metrics are only an indirect measure of literacy skills, being reliable and validated, they can provide a first objective assessment of the complexity of written material, guiding the process of customizing online health-related material to the patient’s reading level and, thus, enhancing patient-centered communication [25,26].

    Acknowledgments

    The authors wish to thank Mr Abed El Rahman Wattad for help in the preparation of the Table of Contents image.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    One-way analysis of variance.

    PDF File (Adobe PDF File), 37KB

    References

    1. Amicizia D, Domnich A, Gasparini R, Bragazzi NL, Lai PL, Panatto D. An overview of current and potential use of information and communication technologies for immunization promotion among adolescents. Hum Vaccin Immunother 2013 Dec;9(12):2634-2642 [FREE Full text] [CrossRef] [Medline]
    2. Bragazzi NL. From P0 to P6 medicine, a model of highly participatory, narrative, interactive, and “augmented” medicine: some considerations on Salvatore Iaconesi's clinical story. Patient Prefer Adherence 2013;7:353-359 [FREE Full text] [CrossRef] [Medline]
    3. Bragazzi NL, Barberis I, Rosselli R, Gianfredi V, Nucci D, Moretti M, et al. How often people google for vaccination: qualitative and quantitative insights from a systematic search of the web-based activities using Google Trends. Hum Vaccin Immunother 2017 Feb;13(2):464-469. [CrossRef] [Medline]
    4. Bragazzi NL, Dini G, Toletone A, Brigo F, Durando P. Leveraging big data for exploring occupational diseases-related interest at the level of scientific community, media coverage and novel data streams: the example of silicosis as a pilot study. PLoS One 2016;11(11):e0166051 [FREE Full text] [CrossRef] [Medline]
    5. Townsend A, Leese J, Adam P, McDonald M, Li LC, Kerr S, et al. eHealth, participatory medicine, and ethical care: a focus group study of patients’ and health care providers’ use of health-related internet information. J Med Internet Res 2015;17(6):e155 [FREE Full text] [CrossRef] [Medline]
    6. Singh AG, Singh S, Singh PP. YouTube for information on rheumatoid arthritis--a wakeup call? J Rheumatol 2012 May;39(5):899-903. [CrossRef] [Medline]
    7. Bragazzi NL, Watad A, Brigo F, Adawi M, Amital H, Shoenfeld Y. Public health awareness of autoimmune diseases after the death of a celebrity. Clin Rheumatol 2016 Dec 20:1-7 (forthcoming). [CrossRef] [Medline]
    8. Makredes M, Robinson D, Bala M, Kimball AB. The burden of autoimmune disease: a comparison of prevalence ratios in patients with psoriatic arthritis and psoriasis. J Am Acad Dermatol 2009 Sep;61(3):405-410. [CrossRef] [Medline]
    9. McInnes N, Haglund BJA. Readability of online health information: implications for health literacy. Inform Health Soc Care 2011 Dec;36(4):173-189. [CrossRef] [Medline]
    10. Wikipedia. 2017 Jun 15.   URL: https://en.wikipedia.org/wiki/Wikipedia [accessed 2017-06-16] [WebCite Cache]
    11. von Muhlen M, Ohno-Machado L. Reviewing social media use by clinicians. J Am Med Inform Assoc 2012;19(5):777-781 [FREE Full text] [CrossRef] [Medline]
    12. American Autoimmune Related Diseases Association. Eastpointe, MI: AARDA; 2017.   URL: https://www.aarda.org/disease-list/ [accessed 2017-06-16] [WebCite Cache]
    13. McGonagle D, McDermott MF. A proposed classification of the immunological diseases. PLoS Med 2006 Aug;3(8):e297 [FREE Full text] [CrossRef] [Medline]
    14. Azer SA, AlSwaidan NM, Alshwairikh LA, AlShammari JM. Accuracy and readability of cardiovascular entries on Wikipedia: are they reliable learning resources for medical students? BMJ Open 2015 Oct 06;5(10):e008187 [FREE Full text] [CrossRef] [Medline]
    15. Candelario DM, Vazquez V, Jackson W, Reilly T. Completeness, accuracy, and readability of Wikipedia as a reference for patient medication information. J Am Pharm Assoc (2003) 2017;57(2):197-200.e1. [CrossRef] [Medline]
    16. Seth AK, Vargas CR, Chuang DJ, Lee BT. Readability assessment of patient information about lymphedema and its treatment. Plast Reconstr Surg 2016 Feb;137(2):287e-295e. [CrossRef] [Medline]
    17. Brigo F, Otte WM, Igwe SC, Tezzon F, Nardone R. Clearly written, easily comprehended? The readability of websites providing information on epilepsy. Epilepsy Behav 2015 Mar;44:35-39. [CrossRef] [Medline]
    18. Thomas GR, Eng L, de Wolff JF, Grover SC. An evaluation of Wikipedia as a resource for patient education in nephrology. Semin Dial 2013;26(2):159-163. [CrossRef] [Medline]
    19. Tulbert BH, Snyder CW, Brodell RT. Readability of patient-oriented online dermatology resources. J Clin Aesthet Dermatol 2011 Mar;4(3):27-33 [FREE Full text] [Medline]
    20. Rajagopalan MS, Khanna VK, Leiter Y, Stott M, Showalter TN, Dicker AP, et al. Patient-oriented cancer information on the internet: a comparison of wikipedia and a professionally maintained database. J Oncol Pract 2011 Sep;7(5):319-323 [FREE Full text] [CrossRef] [Medline]
    21. Azer SA. Evaluation of gastroenterology and hepatology articles on Wikipedia: are they suitable as learning resources for medical students? Eur J Gastroenterol Hepatol 2014 Feb;26(2):155-163. [CrossRef] [Medline]
    22. Volsky PG, Baldassari CM, Mushti S, Derkay CS. Quality of Internet information in pediatric otolaryngology: a comparison of three most referenced websites. Int J Pediatr Otorhinolaryngol 2012 Sep;76(9):1312-1316. [CrossRef] [Medline]
    23. Brigo F, Erro R. The readability of the English Wikipedia article on Parkinson's disease. Neurol Sci 2015 Jun;36(6):1045-1046. [CrossRef] [Medline]
    24. Lasker JN, Sogolow ED, Sharim RR. The role of an online community for people with a rare disease: content analysis of messages posted on a primary biliary cirrhosis mailinglist. J Med Internet Res 2005 Mar 31;7(1):e10 [FREE Full text] [CrossRef] [Medline]
    25. Dini G, Bragazzi NL, D'Amico B, Montecucco A, Igwe SC, Brigo F, et al. A reliability and readability analysis of silicosis-related Italian websites: implications for occupational health. Med Lav 2017 Jun 28;108(3):167-173. [Medline]
    26. Badarudeen S, Sabharwal S. Assessing readability of patient education materials: current role in orthopaedics. Clin Orthop Relat Res 2010 Oct;468(10):2572-2580 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    AARDA: American Autoimmune Related Diseases Association
    ARI: Automated Readability Index
    ICSM: Imperial College School of Medicine
    SMOG: Simple Measure of Gobbledygook


    Edited by G Eysenbach; submitted 16.06.17; peer-reviewed by C Perricone, M Martini, G Murdaca; comments to author 05.07.17; revised version received 06.07.17; accepted 09.07.17; published 18.07.17

    ©Abdulla Watad, Nicola Luigi Bragazzi, Francesco Brigo, Kassem Sharif, Howard Amital, Dennis McGonagle, Yehuda Shoenfeld, Mohammad Adawi. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 18.07.2017.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.