Wikipedia: A Key Tool for Global Public Health Promotion
The Internet has become an important health information resource for patients and the general public. Wikipedia, a collaboratively written Web-based encyclopedia, has become the dominant online reference work. It is usually among the top results of search engine queries, including when medical information is sought. Since April 2004, editors have formed a group called WikiProject Medicine to coordinate and discuss the English-language Wikipedia’s medical content. This paper, written by members of the WikiProject Medicine, discusses the intricacies, strengths, and weaknesses of Wikipedia as a source of health information and compares it with other medical wikis. Medical professionals, their societies, patient groups, and institutions can help improve Wikipedia’s health-related entries. Several examples of partnerships already show that there is enthusiasm to strengthen Wikipedia’s biomedical content. Given its unique global reach, we believe its possibilities for use as a tool for worldwide health promotion are underestimated. We invite the medical community to join in editing Wikipedia, with the goal of providing people with free access to reliable, understandable, and up-to-date health information.
J Med Internet Res 2011;13(1):e14)
- public health;
- health information;
- knowledge dissemination;
- patient education;
- medical education
The Internet allows unprecedented opportunities for patients and the general public to retrieve health information from across the globe. Surveys have shown that online health information retrieval is both common and increasing [- ]. Population-based studies have shown that 61% of American and 52% of European citizens have consulted the Internet for health-related information on at least one occasion [ , ]. Similarly, numerous cross-sectional surveys in patient populations have shown variable but considerable rates of eHealth activities [ - ]. Physicians frequently report that patients have searched the Internet regarding health issues [ , ], although patients do not always discuss these online activities with their doctors [ , ]. Among American e-patients, 44% said this information had a minor impact and 13% said it had a major impact on their decisions about health care [ ].
Websites offering medical information differ widely in their quality . While physicians should reasonably view trustworthy information as useful, some have voiced concerns that Internet information may undermine their authority and lead to self-treatment [ ]. Furthermore, incorrect medical information could result in patient harm. Indeed, about 3% of users of health care information feel that they or someone they know has been seriously harmed by Web-based information [ ]. A potential solution for these drawbacks is that physicians direct online health information seekers to quality resources. This so-called Internet prescription has been evaluated in a few randomized trials, which showed that it increases use of the recommended websites [ - ]. Despite concerns over the quality of health websites, the 2005 Health On the Net survey found that medical Internet users value information availability and ease-of-finding more than accuracy and trustworthiness [ ].
General search engines, of which Google is the market leader in Western countries, appear to be the most common starting point for laypeople seeking health information, despite the existence of eHealth quality labels and special search engines to explore health information [, , , , ]. Search engines commonly lead seekers to Wikipedia [ ]. In the 2009 Pew Internet survey on health information, 53% of e-patients had consulted Wikipedia (not necessarily related to health information) [ ]. This paper examines the role of Wikipedia as a provider of online health information.
Wikipedia: An Internet Heavyweight
Core Features of Wikipedia
Wikipedia is a freely accessible, multilingual, Web-based, free-content encyclopedia that is written collaboratively by volunteers from countries around the world. It is the largest reference website and the most prominent example of a wiki, with over 3.3 million articles in English alone accrued between its inception in January 2001 and May 2010. Wikis allow anyone reading a particular page to also alter it using relatively simple editing commands. Wikipedia maintains a public record of all previous changes to improve collaboration between multiple editors. Everyone is invited to edit, with most changes appearing immediately after submission. Wikipedia is supported by a nonprofit organization, the Wikimedia Foundation, and is free of commercial interests and advertisements. It is one of the most commonly used websites on the Internet, attracting around 362 million visitors monthly as of January 2010 or 29% of global Internet users, making it the sixth most popular website on the Internet [, ]. The multimedia content used across all Wikimedia projects is stored in a central repository (Wikimedia Commons), which hosts more than seven million freely licensed media files.
Content Creation and Maintenance
Wikipedia’s open editorial policy is a departure from the traditional encyclopedias written exclusively by experts. Its editors often write using a pseudonym with no easy way to verify their credentials or expertise. The lack of vetting by identifiable experts has led to the critique that the editorial process favors consensus over credentials . Additions to articles are judged based upon their verifiability, and information added without references may be challenged or removed. The development of Wikipedia’s articles has been described in evolutionary terms; that is, each phrase and sentence is subject to scrutiny and review over and over again, so that eventually “only the fittest” of these will survive, while unsustainable sections will be eliminated [ ]. Fitness is determined by verifiability, ease of understanding, and completeness. The goal is an easy-to-read, thoroughly referenced article that is broad in scope. Such an article is less subject to major edits unless there are changes in the subject matter itself. As articles are improved, editors can nominate them for quality labels. Promotion to Good Article status requires independent review by one editor. A common next step would be Wikipedia’s peer review process, whereby an article is subjected to closer scrutiny from a broader group of editors. The highest-quality articles are Featured Articles, a label that is applied only when there is consensus that the article exemplifies Wikipedia’s best work.
Articles can be damaged in a number of ways, including deletion of information, insertion of misinformation or nonsense, use of offensive language, and addition of spam defined as advertisements or nonuseful links . People who are unaware of Wikipedia’s quality control measures may find it surprising that Wikipedia’s content is not compromised more frequently. However, multiple layers of quality control are in place to prevent or revert spurious additions or removals. These include the following:
- Watchlist: People with an interest in a particular subject can be notified when edits are made to articles they are following.
- Recent changes: Volunteers judge the merits of each change throughout Wikipedia through a list of recent changes (with or without the help of vandalism-fighting software).
- Bots: A system of automated computer scripts, developed by volunteers, fixes a range of problems such as common grammatical and spelling errors, simple vandalism, and copyright violations.
- Page protection: Pages that are highly likely to attract vandalism or controversy can be partly or fully protected from editing by less-established editors.
- Edit filter: Certain edits can be prevented by built-in filters, such as removing references or large sections by new editors. This can also be applied to sensitive medical information: for example, when a filter was established to prevent removal of the Rorschach ink blots [ ].
- Blocking and banning: Both anonymous and logged-in editors who demonstrate noncontributory or disruptive editing (eg, page blanking, spamming) can temporarily or permanently have their editing privileges removed.
Some of these maintenance tools (eg, page protection and blocking) are operated by trusted, established editors called administrators. Although it is impossible to guarantee the validity of every Wikipedia article, as no one person is ultimately responsible for the content, the development of an elaborate antivandalism system explains the paradox of how quality can be sustained in a radically open editing system. In one study, 42% of damaged articles were repaired within one viewing and thus had no impact, while 11% were still present after 100 viewings . This shows that, while the system is surprisingly effective, there remains room for improvement.
As of June 2010, Wikipedia is experimenting with a system of Flagged Revisions or Pending Changes, whereby the edits of anonymous and new users (those with fewer than 200 edits) require a sign-off by an established editor before they are made visible. This system has been in use on the German-language Wikipedia since May 2008, and other-language Wikipedias (eg, Russian and Polish) have followed since. Another system under investigation is WikiTrust, which color codes article content that is unstable and possibly unreliable based on the credibility of content and reputation of the author . Registered users can already modify their settings so that article quality information from assessments is displayed in color at the top of the article. Another proposal includes specifically protecting critical health-related information. We believe that these are examples of a trend toward more control over the editing process.
Who Writes Wikipedia?
Wikipedia has attracted a few thousand prolific and dedicated editors plus a large number of both registered editors (>12 million) and anonymous visitors who make edits less frequently (the so-called long tail) [, ]. About 0.1 % of editors contribute nearly half of Wikipedia’s value as measured by words read [ ]. However, all contributors are needed to improve article content and quality.
Groups of editors interested in a certain field of knowledge can collaborate through so-called WikiProjects. WikiProject Medicine () was founded in April 2004. It has more than 200 listed participants as of 2010, many of whom discuss Wikipedia’s biomedical content at the virtual “doctor’s mess” [ ] ( ) (the authors of this paper are all members of the group). Membership does not require any credentials, but most members are doctors, medical students, nurses, scientists, patients, or laypeople with an interest in specific medical topics. Project members have been responsible for creating a style manual that provides specific guidance on writing health-related articles, including the naming of articles, avoidance of jargon and eponyms, and a standard outline for articles on diseases and medications (in collaboration with WikiProject Pharmacology). Another guideline drafted by WikiProject Medicine participants deals with finding and selecting high-quality references. In accordance with its guideline on verifiability, Wikipedia lends itself very well to evidence-based medicine. Notably, it automatically recognizes PubMed Identifier (PMID) codes (for example, the text “PMID 11720967” would automatically be converted into an external link to the corresponding article’s abstract in Medline).
Wikipedia articles are graded by WikiProjects according to defined quality measures, similar to peer review. Wikipedia contains more than 20,000 health-related articles and more than 6200 articles related to drugs and pharmacology (with an overlap of roughly 700 articles), based on article assessment data from WikiProject Medicine and WikiProject Pharmacology [, ]. Other activities of WikiProject Medicine include a periodic collaboration on a specific article (the Collaboration of the Month) and Task Forces focusing on different specialty topics (eg, cardiology, dermatology).
Wikipedia as a Source of Health Information
A Prominent Resource
Wikipedia contains a large amount of health information, which is accessed extensively by both the lay public and health care providers. Studies have found that 70% of junior physicians use Wikipedia in a given week, while nearly 50% to 70% of practicing physicians use it as an information source in providing medical care [- ]. The junior physicians used Wikipedia more frequently than all other websites excluding Google [ ]. Of pharmacists who responded to a questionnaire, 35% admitted using it [ ]. The medical articles on Wikipedia receive about 150 million page views per month, with the top 200 most-visited medical articles each receiving more than 100,000 views per month and the top 500 each receiving greater than 60,000 views per month [ ]. While some of the most popular articles are of featured or good quality (eg, Asperger syndrome, schizophrenia, and tuberculosis), many other popular articles require improvement. In 2008 the English Wikipedia had the highest average search engine ranking for health terms in comparison with other health resources such as MedlinePlus, WebMD, and NHS Direct. It was ranked among the first 10 Google search hits for medical keywords obtained from various indexes in greater than 70% of cases, being first place in 25% to 33% of cases [ ]. The higher a website is ranked among search engine results, the more likely it is that (inexperienced) searchers will view it, with an exponential decay after the first page of results [ , ]. With the importance of search engines such as Google for people who seek health information, we believe that Wikipedia’s global reach gives it a vast and underestimated potential as a tool for medical knowledge translation.
Wikipedia’s Strengths and Weaknesses
Wikipedia’s approach has proven to be remarkably successful as evidenced by its scope and popularity. The main criticism focuses on the open nature of the editing process, which inherently poses risks of inaccuracies. One commentator summarized the situation as follows: “Wikipedia is both phenomenally successful and, in the eyes of some critics, fundamentally flawed” . A reader can never be absolutely certain that information is not corrupted but, as we have discussed earlier, elaborate quality control mechanisms are in place, and are likely to expand in the future. Another drawback of Wikipedia is that in the intermediate-quality articles, the writing by many different editors may give articles an uneven, choppy quality [ ].
Some people use Wikipedia’s articles to advance their personal beliefs, and so the encyclopedia has been criticized for hosting fringe theories, quackery, and unbalanced views . When editors hold conflicting views regarding the content of an article, an elaborate process exists for dispute resolution, guided by Wikipedia’s core policies of verifiability and neutral point of view. Each article has an associated discussion page where multiple editors can coordinate their efforts and resolve any editing controversies. If this route fails, editors can request assistance from experienced editors, solicit comments from a wider part of the community, and request informal and formal mediation and, ultimately, arbitration. As Wikipedia has grown, the rate of creation of new articles and content has decreased, while levels of maintenance and indirect work (including coordination and conflict resolution) are increasing [ ]. Some editors avoid editing in controversial areas, which is perfectly acceptable since plenty of noncontroversial areas need substantial improvements. Wikipedia has a strict policy against personal threats in discussion, although in extremely rare instances online editing controversies can have consequences in real life (for example, the first author of this article was investigated based on his Wikipedia editing [ ]). As long as editors keep in mind their professional obligations while contributing, we believe that editing Wikipedia poses fewer dangers than social media websites, for example [ , ].
A strength of Wikipedia is its ability to be updated swiftly, whereas traditional peer-reviewed articles in rapidly evolving fields can be outdated even before they are published . Prominent examples of Wikipedia’s capability to update almost instantaneously are articles on disease outbreaks, such as the 2009 influenza pandemic.
Empirical Studies on Wikipedia’s Medical Content
Wikipedia articles have occasionally been cited in scientific articles, although this remains controversial . Between 2004 and 2009, it was among the referenced works in the ISI Web of Science 263 times, while the Encyclopædia Britannica was only cited 10 times [ ]. Wikipedia’s reliability has been tested in a number of studies, notably in a favorable comparison with Britannica [ ]. Wikipedia articles increasingly contain references, with high impact factor medical journals such as the New England Journal of Medicine, The Lancet, the Journal of the American Medical Association, and the British Medical Journal among the 10 most frequently cited science journals in Wikipedia in 2007 [ ].
Empirical studies evaluating Wikipedia’s medical content have recently started to emerge. In a study examining drug information, Medscape Drug Reference provided answers to 82.5 % of predetermined questions, while Wikipedia could answer only 40% . While there were few factual errors, Wikipedia articles were often missing important information, like drug dosages, interactions, and contraindications. However, the authors failed to acknowledge that the Wikipedia style manual for drug articles specifically discourages mentioning dosages, as such information is rarely within the scope of a general encyclopedia and corruption of this information could result in serious harm. The authors did point out that drug company representatives have been caught deleting information from Wikipedia entries that make their drugs look unsafe [ ]. A study that looked at Wikipedia articles pertaining to the most commonly performed inpatient surgical procedures found that, while these pages were accurate, they still had critical content omissions [ ]. Another paper comparing the appropriateness of articles in Wikipedia with those in UpToDate, eMedicine, and AccessMedicine for medical student use found that Wikipedia was the easiest to use and access; however, it lacked the depth and accuracy of the other three traditional online medical resources [ ]. An analysis of the suitability of Wikipedia for nursing students found that the average medical article contained 29 reputable sources [ ].
A recent evaluation found Wikipedia accurate enough to include parts of it in a laboratory observations database . Another Web-based study found that Wikipedia had entries on 82.8% of gastroenterological conditions selected from the International Classification of Diseases, 10th revision [ ]. Of these articles, 65% were substantiated with at least one peer-reviewed reference, and the average number of references per article was 6.8. The median Flesch-Kincaid reading level was above high school grade (13.7 years). Another analysis presented at the 2010 Annual Meeting of the American Society of Clinical Oncology, based on 10 articles dealing with cancer, found that errors “were extremely rare on Wikipedia” (<2%) but information was less easy to understand than that in the US National Cancer Institute’s PDQ (Physician Data Query), a peer-reviewed cancer database [ ]. An assessment of the scope of Wikipedia’s coverage of pathology informatics in 2010 found that 90% of terms in the Association for Pathology Informatics curriculum had a corresponding Wikipedia page. The contents of the pages were deemed comprehensive, of high quality, current, and useful for both the beginner and advanced learners [ ].
The main conclusions that can be drawn from these studies are that the medical information on Wikipedia is found in articles on many topics that contain few factual errors, although the depth of individual articles and the ease of understanding need to be improved substantially. Nevertheless, Wikipedia’s medical disclaimer warns that articles may contain inaccuracies, and Wikipedia’s article on its own reliability states that it can be a valuable starting point when researching a topic, but that users should take care – as with all general reference works – to check facts and be aware that mistakes and omissions do occur.
Comparison With Other Medical Wikis
Wikipedia is but one of many free online encyclopedias with medical content that allow user contributions. At least 70 medical wikis have been cataloged . Some of them are devoted to medical specialties (such as Radiopaedia.org and WikiSurgery.com), while others deal with medicine in general (such as Ganfyd.org and Wikidoc.org). Health topics are also part of Web-based encyclopedias attempting to cover all human knowledge (such as Wikipedia and Citizendium.org). Several specialized medical wikis offer the benefit of verification of the editors’ credentials, and specific topics can be dealt with more elaborately than in a general wiki (even Wikipedia encourages moving overly specific content to dedicated wikis if it falls outside the scope of a general encyclopedia). On the other hand, being a general encyclopedia, Wikipedia has the advantage that topics indirectly related to medicine (eg, concepts of physics or chemistry underlying medicine) are presented in detail in the same encyclopedia.
To achieve sustainability and to guarantee a minimal editing rate, wikis need to establish a critical mass of contributors. A selection of wikis and competing websites is shown in, which demonstrates the unique and dominant position of Wikipedia in terms of access, breadth, and reach (note that although Google Knol is compared with other websites in this table, it is not a wiki). Nevertheless, depth and quality need improvement, as more than 80% of the 20,000 medical articles are still in the earliest developmental stage (Stub- or Start-class articles on the Project Assessment scale), while only 90 articles are Good Articles and 70 are Featured Articles or Lists, approximately.
A Unified Platform for Disseminating Medical Knowledge
Traditionally the medical community has relied on an authoritarian “push” model to disseminate information. Yet with the rapid growth of the Internet as a source of health information, the question is not how we can encourage people to use a particular set of reliable health resources (as with an Internet prescription), but how we can best provide the global community with accessible, free, up-to-date, easy-to-understand, and comprehensive information. Wikipedia already has a worldwide audience for disseminating health information and its format has proven to foster mass collaboration. Why not adopt Wikipedia as the platform for the global medical knowledge database proposed at the dawn of the Medicine 2.0 age ? Instead of each creating their own health information website, patient groups, foundations, charities, professional societies, hospitals, and medical journals could all participate in and contribute to a reference work where most are likely to look first. To quote Peter Frishauf, the founder of Medscape [ ]:
In Wikipedia you read one living article written by many, continually updated by many. Who needs 50 articles on avian flu when one will do?
Increased participation of the medical community is important to improve article quality and will benefit the larger audience of e-patients and health care providers. Physicians will benefit as they can use the free-content articles for patient education. Non-English-speaking patients can be given information in their native languages if these pages are available and satisfactory, or the English article could be translated into one of the more than 250 languages in which Wikipedia exists.
A Call to Action
Of American physicians who use Wikipedia about 10% edited one or more articles . A study in Germany looked at motives for editing Wikipedia and determined that participants had a high degree of intrinsic motivation, enjoyed their autonomy when contributing, found their work to be of significance, and accepted the time and effort needed to invest in this activity to derive these benefits in return [ ]. Studies have not examined why health professionals would participate in editing and organizing medical articles on Wikipedia. This requires much time and effort and, contrary to scientific publications, Wikipedia articles have no direct authorship, thus the prestige of authorship so typical for scientific articles is not attained. An attempt at recognition of authorship can be found more explicitly in competing websites such as Google Knol or Medpedia. However, the high search engine ranking of Wikipedia led Peter Frishauf to conclude [ ]:
For writers, Wikipedia offers neither authorship, recognition, reward, nor punishment. Articles aren’t indexed, but with Google and Yahoo!, who needs it? The motivation for writing is love of information and a desire to share it.
We propose that physicians may contribute to Wikipedia for several reasons:
- It may be personally satisfying to provide an important educational service for individuals looking for health information, and to see articles grow that one created or improved.
- While not having a high scientific impact, Wikipedia’s articles have a high social impact due to its broad readership. In the experience of the authors, a newly created article can often be found among the top Google results within a day, often outperforming review articles in highly regarded medical journals.
- Editing or adding information helps contributing students or professionals master the subject matter and learn more about the evidence underpinning it.
- Translating complex ideas into accessible concepts and language is an interesting intellectual challenge, which can help in everyday nontechnical communication with patients.
- Writing for Wikipedia teaches modern online communication.
- WikiProject Medicine offers participation and recognition in a Web-based international community.
Wikipedia can be used as an education opportunity for both students and physicians. Medical schools should challenge their students not only to read Wikipedia’s articles critically, but also to rewrite, discuss, critique, and improve them. The experiences of a group of graduate students editing Wikipedia was described in a 2009 publication as “extremely valuable as an exercise in critical thinking and communication skills” .
Several options exist to create direct incentives for health professionals and biomedical scientists to contribute to Wikipedia. WikiProject Medicine members are applying to get recognition as a continuing medical education (CME) opportunity, so that professionals could get credits for editing medical content. Authorship of Wikipedia could also be counted similarly to a scientific publication for people requesting grants or funding. Scientific journals could couple traditional publishing with contributions to Wikipedia. An example of this is the scientific journal RNA Biology, which requires authors on a series of review articles on RNA families to also update or create the relevant Wikipedia entry . Similarly, medical journals could enhance their “social impact factor” [ ] by requiring submitting authors to review a related Wikipedia entry, or by releasing a key figure or clinical image under a free-content license so that it can be incorporated into Wikipedia.
Examples of Collaborations
Recently the US National Institutes of Health have started an initiative to encourage its scientists to contribute to Wikipedia. This is a recognition of Wikipedia’s global reach and an effort to strengthen Wikipedia’s scientific underpinnings . A collaboration of the RNA WikiProject with the Rfam database, a collection of RNA families, has allowed mutual data exchange and community annotation of the Rfam database [ ]. Google.org, the philanthropic arm of Google that uses information and technology to address global challenges in areas such as health, poverty, and the environment, is reviewing and translating medical articles [ ]. Wikipedia’s open access model makes it ideally placed for health education in developing and developed countries alike. For example, Wikipedia articles are used for humanitarian purposes in the One Laptop per Child Project and the CD selection for SOS Children UK, and so its medical articles could assist in providing health care information for all [ - ].
Wikipedia’s goal is to give the world free access to the sum of all human knowledge. Pursuing this, Wikipedia has evolved into an important medical resource for the general public, students, and health care professionals. While it has attracted a sizable number of experts that are enlarging its medical content, its potential to improve health may not yet be fully appreciated. While some authors have called for a variant of Wikipedia for medicine [, ], many wikis have until now failed to attract the required long tail of editors. We believe that duplicate efforts will hurt the quality of available online information because the scarce number of active contributors is spread thinly over multiple resources. Furthermore, we hope Wikipedia will expand quality control measures in the future. Collaborations with other organizations should be set up to provide direct incentives for experts to contribute (such as coupling Wikipedia editing with article publication, with CME credits, or with funding).
In conclusion, we invite the medical community to join us in editing Wikipedia, with the goal of promoting health by providing readers worldwide with free access to reliable, understandable, and up-to-date health information.
Conflicts of Interest
All authors are members of the English Wikipedia's WikiProject Medicine and have contributed to Wikipedia and various other wikis. Michael F Martone is involved in the development of an iPhone application that may in the future integrate Wikipedia content. Tim Vickers is Director of the Molecular and Cellular Biology WikiProject. Dr Bertalan Meskó is the founder and managing director of Webicina.com, a company providing web 2.0 services to medical professionals and patients.
- Kummervold PE, Chronaki CE, Lausen B, Prokosch HU, Rasmussen J, Santana S, et al. eHealth trends in Europe 2005-2007: a population-based survey. J Med Internet Res 2008;10(4):e42 [FREE Full text] [CrossRef] [Medline]
- Hesse BW, Nelson DE, Kreps GL, Croyle RT, Arora NK, Rimer BK, et al. Trust and sources of health information: the impact of the Internet and its implications for health care providers: findings from the first Health Information National Trends Survey. Arch Intern Med 2005;165(22):2618-2624 [FREE Full text] [CrossRef] [Medline]
- Trotter MI, Morgan DW. Patients' use of the Internet for health related matters: a study of Internet usage in 2000 and 2006. Health Informatics J 2008 Sep;14(3):175-181. [CrossRef] [Medline]
- Fox S, Jones S. Pew Internet. Washington, DC: Pew Internet & American Life Project; 2009. The social life of health information URL: http://www.pewinternet.org/~/media//Files/Reports/2009/PIP_Health_2009.pdf [accessed 2010-07-12] [WebCite Cache]
- Iverson SA, Howard KB, Penney BK. Impact of internet use on health-related behaviors and the patient-physician relationship: a survey-based study and review. J Am Osteopath Assoc 2008 Dec;108(12):699-711 [FREE Full text] [Medline]
- Atkinson NL, Saperstein SL, Pleis J. Using the internet for health-related activities: findings from a national probability sample. J Med Internet Res 2009;11(1):e4 [FREE Full text] [CrossRef] [Medline]
- Bouche G, Migeot V. Parental use of the Internet to seek health information and primary care utilisation for their child: a cross-sectional study. BMC Public Health 2008;8:300 [FREE Full text] [CrossRef] [Medline]
- Zhang Y, Jones B, Spalding M, Young R, Ragain M. Use of the Internet for Health Information Among Primary Care Patients in Rural West Texas. South Med J 2009 May 7. [CrossRef] [Medline]
- Khoo K, Bolt P, Babl FE, Jury S, Goldman RD. Health information seeking by parents in the Internet age. J Paediatr Child Health 2008 Aug;44(7-8):419-423. [CrossRef] [Medline]
- Dickerson S, Reinhart AM, Feeley TH, Bidani R, Rich E, Garg VK, et al. Patient Internet use for health information at three urban primary care clinics. J Am Med Inform Assoc 2004;11(6):499-504. [CrossRef] [Medline]
- Murray E, Lo B, Pollack L, Donelan K, Catania J, Lee K, et al. The impact of health information on the Internet on health care and the physician-patient relationship: national U.S. survey among 1.050 U.S. physicians. J Med Internet Res 2003;5(3):e17 [FREE Full text] [CrossRef] [Medline]
- Schwartz KL, Roe T, Northrup J, Meza J, Seifeldin R, Neale AV. Family medicine patients' use of the Internet for health information: a MetroNet study. J Am Board Fam Med 2006 Feb;19(1):39-45 [FREE Full text] [Medline]
- Health On the Net Foundation. Analysis of 9th HON Survey of Health and Medical Internet Users, Winter 2004 - 2005 URL: http://www.hon.ch/Survey/Survey2005/res.html [accessed 2010-05-17] [WebCite Cache]
- Bylund CL, Gueguen JA, D'Agostino TA, Imes RS, Sonet E. Cancer patients' decisions about discussing Internet information with their doctors. Psychooncology 2009 Nov;18(11):1139-1146. [CrossRef] [Medline]
- Eysenbach G, Powell J, Kuss O, Sa ER. Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA 2002;287(20):2691-2700 [FREE Full text] [Medline]
- Ritterband LM, Borowitz S, Cox DJ, Kovatchev B, Walker LS, Lucas V, et al. Using the internet to provide information prescriptions. Pediatrics 2005 Nov;116(5):e643-e647 [FREE Full text] [CrossRef] [Medline]
- D'Alessandro DM, Kreiter CD, Kinzer SL, Peterson MW. A randomized controlled trial of an information prescription for pediatric patient education on the Internet. Arch Pediatr Adolesc Med 2004 Sep;158(9):857-862 [FREE Full text] [CrossRef] [Medline]
- Coberly E, Boren SA, Davis JW, McConnell AL, Chitima-Matsiga R, Ge B, et al. Linking clinic patients to Internet-based, condition-specific information prescriptions. J Med Libr Assoc 2010 Apr;98(2):160-164. [CrossRef] [Medline]
- Eysenbach G, Köhler C. How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. BMJ 2002 Mar 9;324(7337):573-577 [FREE Full text] [Medline]
- Hansen DL, Derry HA, Resnick PJ, Richardson CR. Adolescents searching for health information on the Internet: an observational study. J Med Internet Res 2003 Oct 17;5(4):e25 [FREE Full text] [CrossRef] [Medline]
- Laurent MR, Vickers TJ. Seeking health information online: does Wikipedia matter? J Am Med Inform Assoc 2009;16(4):471-479. [CrossRef] [Medline]
- Wikimedia Meta-Wiki. comScore data on Wikimedia URL: http://meta.wikimedia.org/wiki/User:Stu/comScore_data_on_Wikimedia [accessed 2010-06-06] [WebCite Cache]
- Alexa: The Web Information Company. Top Sites: The Top 500 Sites on the Web URL: http://www.alexa.com/topsites [accessed 2010-06-01] [WebCite Cache]
- Boyd D. Corante. 2005 Jan 04. Many 2 Many: A Group Weblog on Social Software: Academia and Wikipedia URL: http://many.corante.com/archives/2005/01/04/academia_and_wikipedia.php [accessed 2010-05-17] [WebCite Cache]
- McLean R, Richards BH, Wardman JI. The effect of Web 2.0 on the future of medical practice and education: Darwikinian evolution or folksonomic revolution? Med J Aust 2007 Aug 6;187(3):174-177 [FREE Full text] [Medline]
- Priedhorsky R, Chen JK, Lam SK, Panciera K, Terveen L, Riedl J. Creating, destroying, and restoring value in Wikipedia. In: Riedl J, editor. Proceedings of the 2007 international ACM Conference on Supporting Group Work. New York, NY: ACM Press; 2007:259-268.
- Cohen N. New York Times. 2009 Jul 29. A Rorschach Cheat Sheet on Wikipedia? URL: http://www.nytimes.com/2009/07/29/technology/internet/29inkblot.html?_r=1 [accessed 2010-06-06] [WebCite Cache]
- Leggett H. Wired Science. 2009 Aug 30. Wikipedia to Color Code Untrustworthy Text URL: http://www.wired.com/wiredscience/2009/08/wikitrust/ [accessed 2010-05-17] [WebCite Cache]
- Chi EH, Kittur A, Pendleton BA, Suh B. Augmented Social Cognition Research Blog from PARC. 2007 May 15. Long Tail of User Participation in Wikipedia URL: http://asc-parc.blogspot.com/2007/05/long-tail-and-power-law-graphs-of-user.html [accessed 2010-06-06] [WebCite Cache]
- Wikipedia. Statistics URL: http://en.wikipedia.org/wiki/Special:Statistics [accessed 2010-06-06] [WebCite Cache]
- Wikipedia talk. 2010 Jun 09. WikiProject Medicine URL: http://en.wikipedia.org/wiki/Wikipedia_talk:WikiProject_Medicine [accessed 2010-06-09] [WebCite Cache]
- Wikipedia. 2010 Jun 02. WikiProject Medicine/Assessment URL: http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Medicine/Assessment [accessed 2010-06-06] [WebCite Cache]
- Wikipedia. 2010 Jul 17. WikiProject Pharmacology/Assessment URL: http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Pharmacology/Assessment [accessed 2010-08-14] [WebCite Cache]
- Hughes B, Joshi I, Lemonde H, Wareham J. Junior physician's use of Web 2.0 for information seeking and medical education: a qualitative study. Int J Med Inform 2009 Oct;78(10):645-655. [CrossRef] [Medline]
- Comer B. Medical Marketing & Media. 2009 Apr 21. Docs Look to Wikipedia for Condition Info: Manhattan Research URL: http://www.mmm-online.com/docs-look-to-wikipedia-for-condition-info-manhattan-research/article/131038/ [accessed 2010-05-21] [WebCite Cache]
- Hughes B, Wareham J, Joshi I. Doctors' online information needs, cognitive search strategies, and judgments of information quality and cognitive authority: how predictive judgments introduce bias into cognitive search models. J Am Soc Inf Sci Technol 2010;61(3):433-452.
- Brokowski L, Sheehan AH. Evaluation of pharmacist use and perception of Wikipedia as a drug information resource. Ann Pharmacother 2009 Nov;43(11):1912-1913. [CrossRef] [Medline]
- Wikipedia. 2010 May 01. WikiProject Medicine/Popular pages URL: http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Medicine/Popular_pages [accessed 2010-05-21] [WebCite Cache]
- Giles J. Wikipedia rival calls in the experts. Nature 2006 Oct 5;443(7111):493. [CrossRef] [Medline]
- Rosenzweig R. Can history be open source? Wikipedia and the future of the past. J Am Hist 2006;93(1):117-146 [FREE Full text] [WebCite Cache]
- Goodman MJ. Readers' and author's responses to "are traditional peer-reviewed medical articles obsolete?". MedGenMed 2006;8(1):70; author reply 70 [FREE Full text] [Medline]
- Kittur A, Suh B, Pendleton BA, Chi EH. He says, she says: conflict and coordination in Wikipedia. In: Chi EH, editor. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York, NY: ACM Press; 2007:453-462.
- Cohen N. New York Times. 2009 Aug 23. Complaint over doctor who posted inkblot test URL: http://www.nytimes.com/2009/08/24/business/24inkblot.html?_r=1 [accessed 2010-08-14] [WebCite Cache]
- Jain SH. Practicing medicine in the age of Facebook. N Engl J Med 2009 Aug 13;361(7):649-651 [FREE Full text] [CrossRef] [Medline]
- Thompson LA, Dawson K, Ferdig R, Black EW, Boyer J, Coutts J, et al. The intersection of online social networking with medical professionalism. J Gen Intern Med 2008 Jul;23(7):954-957. [CrossRef] [Medline]
- Frishauf P. Are traditional peer-reviewed medical articles obsolete? MedGenMed 2006;8(1):5 [FREE Full text] [Medline]
- Stillman-Lowe C. Wikipedia comes second. Br Dent J 2008 Nov 22;205(10):525. [CrossRef] [Medline]
- Noruzi A. Wikipedia popularity from a citation analysis point of view. Webology 2009 Jun;6(2):20 [FREE Full text] [WebCite Cache]
- Giles J. Internet encyclopaedias go head to head. Nature 2005 Dec 15;438(7070):900-901. [CrossRef] [Medline]
- Nielsen FA. Scientific citations in Wikipedia. First Monday 2007 Aug;12(8) [FREE Full text] [WebCite Cache]
- Clauson KA, Polen HH, Boulos MN, Dzenowagis JH. Scope, completeness, and accuracy of drug information in Wikipedia. Ann Pharmacother 2008 Dec;42(12):1814-1821. [CrossRef] [Medline]
- Devgan L, Powe N, Blakey B, Makary M. Wiki-Surgery? Internal validity of Wikipedia as a medical and surgical reference. J Am Coll Surg 2007;205(3S):S76-S77.
- Pender MP, Lasserre KE, Del Mar C, Kruesi L, Anuradha S. Is Wikipedia unsuitable as a clinical information resource for medical students? Med Teach 2009 Dec;31(12):1095-1096. [Medline]
- Haigh CA. Wikipedia as an evidence source for nursing and healthcare students. Nurse Educ Today 2010 Jun 19. [CrossRef] [Medline]
- Friedlin J, McDonald CJ. An evaluation of medical knowledge contained in Wikipedia and its use in the LOINC database. J Am Med Inform Assoc 2010 May 1;17(3):283-287. [CrossRef] [Medline]
- Czarnecka-Kujawa K, Abdalian R, Grover SC. The quality of Open Access and Open Source Internet material in gastroenterology: is Wikipedia appropriate for knowledge transfer to patients? Gastroenterology 2008;134(4S1):A-325-A-326. [CrossRef]
- Rajagopalan MS, Khanna V, Stott M, Leiter Y, Showalter TN, Dicker A, et al. Accuracy of cancer information on the Internet: a comparison of a Wiki with a professionally maintained database. J Clin Oncol 2010;7(suppl):abstr 6058 [FREE Full text] [WebCite Cache]
- Kim JY, Gudewicz TM, Dighe AS, Gilbertson JR. The pathology informatics curriculum wiki: harnessing the power of user-generated content. J Pathol Inform 2010 Jul 13;1:10 [FREE Full text] [CrossRef] [Medline]
- Rothman R. davidrothman.net. 2009 Jan 21. List of Medical Wikis URL: http://davidrothman.net/list-of-medical-wikis/ [accessed 2010-05-17] [WebCite Cache]
- Dawes M, Godwin M. Global medical knowledge database is proposed. BMJ 2000 May 13;320(7245):1340 [FREE Full text] [Medline]
- Schoer J, Hertel G. Virtual Collaboration Network, Department of Organisational Psychology, University of Muenster. 2007 Dec 3. Voluntary Engagement in an Open Web-based Encyclopedia: Wikipedians, and Why They Do It URL: http://www.psy.uni-muenster.de:8019/publications.php?action=view&id=44 [accessed 2010-05-17] [WebCite Cache]
- Callis KL, Christ LR, Resasco J, Armitage DW, Ash JD, Caughlin TT, et al. Improving Wikipedia: educational opportunity and professional responsibility. Trends Ecol Evol 2009 Apr;24(4):177-179. [CrossRef] [Medline]
- Butler D. Publish in Wikipedia or perish. Nature News 2008 Dec 16. [CrossRef]
- Smith R. Measuring the social impact of research. BMJ 2001 Sep 8;323(7312):528 [FREE Full text] [Medline]
- Caputo I. Washington Post. 2009 Jul 28. NIH staffers get into the wiki world: scientists learn online etiquette URL: http://www.washingtonpost.com/wp-dyn/content/article/2009/07/27/AR2009072701912.html [accessed 2010-05-17] [WebCite Cache]
- Daub J, Gardner PP, Tate J, Ramsköld D, Manske M, Scott WG, et al. The RNA WikiProject: community annotation of RNA families. RNA 2008 Dec;14(12):2462-2464 [FREE Full text] [CrossRef] [Medline]
- Wikipedia. 2010 Sep 02. Announcement to WikiProject Medicine community prior to trial editorial review URL: http://en.wikipedia.org/wiki/Wikipedia_talk:WikiProject_Medicine/Archive_18 [accessed 2010-06-06] [WebCite Cache]
- Wikimedia press release. 2006 Aug 04. One Laptop Per Child Includes Wikipedia on $100 Laptops URL: http://meta.wikimedia.org/wiki/Press_releases/One_Laptop_Per_Child_Includes_Wikipedia_on_$100_Laptops [accessed 2010-06-06] [WebCite Cache]
- Wikimedia press releases. 2008 Oct 22. SOS Children UK and the Wikimedia Foundation Announce the 2008/9 Wikipedia Selection for Schools URL: http://wikimediafoundation.org/wiki/Press_releases/2008-9_Selection_for_Schools [accessed 2010-06-06] [WebCite Cache]
- HIFA2015. A Global Campaign: Healthcare Information for All by 2015 URL: http://www.hifa2015.org/about/ [accessed 2010-06-06] [WebCite Cache]
- Giustini D. How Web 2.0 is changing medicine. BMJ 2006 Dec 23;333(7582):1283-1284. [CrossRef] [Medline]
|CME: continuing medical education|
|PMID: PubMed Identifier|
Edited by G Eysenbach; submitted 21.06.10; peer-reviewed by D Giustini, B Hughes, J Friedlin, R Ward, R Dellavalle, L Osborn, J Mohit; comments to author 12.07.10; revised version received 16.08.10; accepted 27.08.10; published 31.01.11
©James M Heilman, Eckhard Kemmann, Michael Bonert, Anwesh Chatterjee, Brent Ragar, Graham M Beards, David J Iberri, Matthew Harvey, Brendan Thomas, Wouter Stomp, Michael F Martone, Daniel J Lodge, Andrea Vondracek, Jacob F de Wolff, Casimir Liber, Samir C Grover, Tim J Vickers, Bertalan Meskó, Michaël R Laurent. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 31.01.2011.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.