Published on 06.08.08 in Vol 10, No 3 (2008): Medicine 2.0 Theme Issue: Web 2.0 in Health, Health Care, Medicine, and Biomedical Research
Health 2.0 and Medicine 2.0: Tensions and Controversies in the Field
Background: The term Web 2.0 became popular following the O’Reilly Media Web 2.0 conference in 2004; however, there are difficulties in its application to health and medicine. Principally, the definition published by O’Reilly is criticized for being too amorphous, where other authors claim that Web 2.0 does not really exist. Despite this skepticism, the online community using Web 2.0 tools for health continues to grow, and the term Medicine 2.0 has entered popular nomenclature.
Objective: This paper aims to establish a clear definition for Medicine 2.0 and delineate literature that is specific to the field. In addition, we propose a framework for categorizing the existing Medicine 2.0 literature and identify key research themes, underdeveloped research areas, as well as the underlying tensions or controversies in Medicine 2.0’s diverse interest groups.
Methods: In the first phase, we employ a thematic analysis of online definitions, that is, the most important linked papers, websites, or blogs in the Medicine 2.0 community itself. In a second phase, this definition is then applied across a series of academic papers to review Medicine 2.0’s core literature base, delineating it from a wider concept of eHealth.
Results: The terms Medicine 2.0 and Health 2.0 were found to be very similar and subsume five major salient themes: (1) the participants involved (doctors, patients, etc); (2) its impact on both traditional and collaborative practices in medicine; (3) its ability to provide personalized health care; (4) its ability to promote ongoing medical education; and (5) its associated method- and tool-related issues, such as potential inaccuracy in enduser-generated content. In comparing definitions of Medicine 2.0 to eHealth, key distinctions are made by the collaborative nature of Medicine 2.0 and its emphasis on personalized health care. However, other elements such as health or medical education remain common for both categories. In addition, this emphasis on personalized health care is not a salient theme within the academic literature. Of 2405 papers originally identified as potentially relevant, we found 56 articles that were exclusively focused on Medicine 2.0 as opposed to wider eHealth discussions. Four major tensions or debates between stakeholders were found in this literature, including (1) the lack of clear Medicine 2.0 definitions, (2) tension due to the loss of control over information as perceived by doctors, (3) the safety issues of inaccurate information, and (4) ownership and privacy issues with the growing body of information created by Medicine 2.0.
Conclusion: This paper is distinguished from previous reviews in that earlier studies mainly introduced specific Medicine 2.0 tools. In addressing the field’s definition via empirical online data, it establishes a literature base and delineates key topics for future research into Medicine 2.0, distinct to that of eHealth.
J Med Internet Res 2008;10(3):e23
O’Reilly defines Web 2.0 by a series of case examples, noting the characteristics of a Web 2.0 company, such as (1) hard-to-recreate data sources that get richer as more people use them, (2) harnessing collective intelligence, and (3) levering the “long tail” through customer self service . However, critics have claimed this definition is too amorphous [ ] and have attempted to narrow it [ ]. Despite these attempts, researchers can view Web 2.0 in its widest sense, incorporating all tools such as search (eg, Google) and Podcasts [ , ]. Since many top websites [ ] encompass some of these characteristics, such as use of RSS feeds, it poses a concern that Web 2.0 and the Internet are synonymous. Furthermore, existing research fields in medicine, such as interactive health communication applications (IHCAs), overlap significantly with components of Medicine 2.0. These ambiguities imply that Medicine 2.0 is not a separate research field.
However, we argue that Medicine 2.0 has certain characteristics that warrant analysis distinct from eHealth. First, there is the number of online references to Web 2.0, Health 2.0, and Medicine 2.0 (187-224 million, 0.5-1.7 million, and 0.1-0.4 million, respectively, depending on the search engine used). Second, there is extensive literature loosely associated with O’Reilly’s definition, such as Wikinomics , Democratizing Innovation [ ], or the literature identified in this review. Third, related topics such as IHCAs and eHealth either do not cover all aspects of Medicine 2.0 or have a different focus. For instance, IHCAs were defined before recent Internet developments such as Wikipedia, which is reflected in doubts about which sites apply to IHCAs [ ]. Hence, we believe the main issue is that a clearer definition or demarcation of Medicine 2.0 is warranted.
We employ data garnered from practising online communities to answer the following research questions:
- Can a clear definition of Medicine 2.0 be established across practitioner and academic literature that distinguishes this field from eHealth?
- Is there agreement between online discussions and academic communities in their use of the term Medicine 2.0? If not, what does such divergence imply for future research?
- What are the major tensions between the main stakeholders in Medicine 2.0 communities as identified by research?
Toward this aim, we used Google’s PageRank system to identify the most popular online discussions and delineate key themes through thematic analysis. We started by clarifying the Web 2.0 definition as some researchers suggest that aspects of its application to medicine cannot be assumed . We then examined both academic literature and online discussions to find key identifying terms and salient themes associated with Medicine 2.0 (or other health “2.0”–related terms). Indeed, the Medicine 2.0 definition was found to be different from simply applying the rule “Medicine 2.0 = Medicine + Web 2.0,” particularly in its emphasis on personalized health care and its participants. In addition, we found only minor differences between the salient themes in Health 2.0 and Medicine 2.0.
In a second phase, we applied these salient themes as a definition to the academic literature associated with Medicine 2.0 to broadly delineate the field. In doing this, we found four major tensions in the field. Moreover, we determined that academic literature does not explore personalized or customized health care in the detail that this theme is treated online. Finally, as could be expected, we found a gray area with papers that clearly have implications for Medicine 2.0 but do not correspond to many of the salient themes associated with it.
This paper makes a distinct contribution to the Medicine 2.0 field by empirically demarcating its thematic boundaries and differentiating it from Web 2.0 and Health 2.0, as well as online versus academic perspectives.
Identifying Medicine 2.0 Salient Themes and Vocabulary
Medicine 2.0 focuses strongly on the use of Web 2.0 tools. However, as a term only four years old and constantly evolving as new tools emerge, academic literature is unlikely to have achieved consensus on its scope as quickly as 2008. For this reason, we used Google’s PageRank system to identify the tools or benefits most important to Web 2.0. Google’s PageRank relies on the democratic nature of the Web’s vast link structure to indicate an individual page’s value. Google interprets a link from page A to B as a vote by page A for page B. Google looks at more than the sheer volume of votes; if the page that casts the vote also has many links to it, this vote cast by that page weighs more heavily .
To refine the approach, and to enable a contrast to Medicine 2.0’s salient themes, we started with Web 2.0. We searched with Google for “Web 2.0” to identify the most linked pages with the term. These pages were coded using thematic analysis  to identify the terms describing both tool types and the purpose or benefits of Web 2.0. Articles coded included not only the Wikipedia entry and O’Reilly’s definitions, but also a series of blog threads, including over 50 contributions from users attempting to define Web 2.0. The full results of this approach are available in a separate publication [ ], but we adapted the approach for this paper and used the result, which summarizes Web 2.0 as:
Democratized Collaborations; a collaboration enabled by web technology that promotes learning and innovation. Democratized collaborations work by connecting participants to harness network effects and knowledge in an open and interactive manner.
Defining Medicine 2.0
A similar approach was used to delineate Medicine 2.0, but no assumption was made that identifying terms such as Medicine 2.0 should take precedence over Physician 2.0 as the researchers had a priori knowledge that numerous terms are associated with the field. Hence, in the first two steps in the method below, we try to determine the identifying terms that describe the field. Step 3 identifies the most popular online discussions relevant to the field, and, finally, steps 4-6 use the comparative method for thematic analysis as described by Techniques and Procedures for Developing Grounded Theory  to understand the salient themes. Steps 3-6 were effectively completed three times in order to obtain intercoder reliability of 82% agreement for exact phrases across all of the pages analyzed.
In a second phase, carried out in step 7, the original sample of 2405 academic papers identified as being potentially related to Web 2.0 and health was reduced to 56 papers after excluding those not directly addressing Medicine 2.0, duplicate search results, or papers not available in English. The initial number of papers and those selected for the review are shown in brackets in step 1 of the methodology outlined in.
|1||Determine the field’s identifying terms from academic literature||We examined journals through search tools including PubMed (170:16), Blackwell Synergy (159:3), Science Direct (52:2), Emerald Insight (21:1), SpringerLink (20:1), JAMA (10:1), Wiley Interscience (109:0), and Google Scholar (1864:32). Any paper with a combination of “web” and “2.0” and restricted to medicine or health science journals was considered. The Google Scholar search was based on “Web 2.0” and “medicine” or “health.” All key “2.0” terms found in these paper titles or abstracts were identified (eg, “Medicine 2.0”). This and subsequent use of literature covers papers up to the end of March 2008.|
|2||Determine the popularity of academic literature’s identifying terms online||These terms were used to search Google to determine the support for the particular term (eg, the number of references matching “Health librarian 2.0”) online.|
|3||Determine the most popular pages associated with the identifying terms||Identifying terms with the most online references (eg, “Health 2.0” and “Medicine 2.0”) were used as a search term in Google to identify the most popular associated pages. Google’s PageRank system returns the most popular and most viewed pages as denoted by the richer-get-richer phenomena noted by a number of authors [, ]. While these pages are the most popular, their contribution to the field may not be the most important [ ], necessitating step 5.|
|4||Identify salient themes using thematic analysis||The online discussions in the popular pages were analyzed by two researchers using thematic analysis  to identify salient themes. This process involves open coding, axial coding, and selective coding in an iterative process of analyzing qualitative data (ie, text). Units of text (ie, words, phrases, sentences, or paragraphs) are labeled, compared, and grouped until no new categories emerge. Coders were instructed to look for manifest-type content that describes the field. Manifest content is that which resides on the surface of communication and is therefore easily observable, as this can improve reliability and puts less interpretative burden on coders [ ]. As such, exact phrases that were found in the pages were used, though the unit of analysis combined both the exact phrase and the theme (an approach noted in studies such as [ ]).|
|5||Identify order of importance of pieces of exact phrases associated with salient themes||As noted in step 3, the most popular pages do not necessarily make the only important contributions to define the field, even though they do potentially play a more important role than other pages. The exact phrases associated with the different salient themes identified were re-entered into four different search engines to understand their frequency of use online or their relative ranking.By ranking, we mean the frequency of use as indicated by the count function of the search engine compared to other phrases using the same search engine. The search text included the identifying term as set out in.In this way, we were able to identify the importance of this exact phrase across all online content, reducing reliance on the popular pages analyzed. Exact phrase within themes were excluded if they did not have minimum counts that met search engine reliability thresholds (eg, less than 1000 for Google, 8000 for Microsoft Live Search) [ , ].|
|6||Identify further salient themesuntil saturation||Additional online descriptions continued to be coded until saturation (eg, nine online articles were examined for Health 2.0, and the next two examined did not identify any phrases with over a 1000 counts online). At this point, the independent coders compared and returned to step 3, where required, to address interrater reliability and integrity.|
|7||Define field scope and review academic literature to determine related publications and key tensions||This understanding of salient themes and the frequency of use of exact pieces of text online was used to provide an updated definition of Medicine 2.0 and structure the academic literature into key themes. The original set of academic papers identified in step 1 was critically examined to determine if the papers were, in fact, Medicine 2.0, to clearly delineate between Medicine 2.0 and eHealth literature. Two researchers independently assessed the literature to determine if it was specific to Medicine 2.0. The differences were resolved by discussion between the two researchers. Key tensions were identified via discussions with the whole research team.|
Determine Field’s Identifying Terms
The abstracts and titles of the 2405 papers indicated that “2.0” was associated with Health 2.0, Medicine 2.0, Physician 2.0, Nursing Education 2.0, Medical Librarian 2.0, and Physician Learning 2.0.
Determine the Popularity of Identifying Terms Online
shows how often the terms used by academics are replicated in the community itself (via Google search). The results show that “Health 2.0” or “Health” and “Web 2.0” are the most commonly discussed terms. The prominence of Health 2.0 and Medicine 2.0 meant only these terms were examined for more precise definitions as detailed by steps 3-6 in the Methods.
|Search Term||Google Count|
|“health” and ”web 2.0” or “health 2.0”||1,617,000|
|“medicine” and “web 2.0” or “medicine 2.0”||474,900|
|“physician 2.0” or “physician” and “web 2.0”||126,000|
|“medical librarian 2.0” or “medical librarian” and “web 2.0”||9560|
|“nursing education 2.0” or “nursing education” and “web 2.0”||5612|
|“physician learning 2.0” or “physician learning” and “web 2.0”||271|
Identify Salient Themes and Popularity of Associated Phrases
For both terms, open coding of the top online descriptions quickly lead to saturation, in the case of Medicine 2.0, after seven articles (articles coded: [, - ]) and after nine for Health 2.0 (articles coded: [ - ]). In the early axial and selective coding stages, four core terms were identified: participants or actors, tools, methods, and purpose or objectives. The salient themes or grouping applied to both identifying terms, and there was almost no difference with the ranking (in terms of counts) of exact phrases associated with these themes. Overall, there were few differences between Health 2.0 and Medicine 2.0 in terms of participants, and and show the individual counts for each term. It is worth noting than one exact phrase, “Privacy,” was identified by both researchers but was not possible to rank using search engines. Different search engines provided widely different rankings for this term (from first to last within the methods and tools grouping), which we believe reflected the fact that some search engines perform key word searchers through the footers of cached pages (see Discussion).
|Salient Theme||Associated Exact Phrase||Ranking (relative frequency of use online)|
|Methods||Commons, open access||1||1||1||1||1|
|Wisdom of crowds, network effects||2||2||3||4||2.75|
|User generated content||3||3||4||3||3.25|
|Purpose/ Objectives||Collaborate, facilitate collaboration||1||1||1||1||1|
|Personalized, customized information||2||2||2||2||2|
|Free access, free services||5||4||4||4||4.25|
|Salient Theme||Associated Exact Phrase||Ranking (relative frequency of use online)|
|Medical librarians, health librarians||9||9||9||9||9|
|Tagging, bookmarking, social search||3||3||6||3||3.75|
|Methods||Open source, open platforms||1||1||1||1||1|
|User generated, user innovation||2||2||2||2||2|
|Participation, power of networks||3||3||3||3||3|
|Reliable information, medical errors||6||5||5||6||5.5|
|Virtual communities, social groups||7||7||7||7||7|
|Purpose/Objectives||Long tail, personalized||1||1||1||1||1|
|e-learning, medical education, mobile learning, health education, active learning||3||3||2||3||2.75|
Define Field Scope and Review Academic Literature
Given the similar definitions of Health 2.0 and Medicine 2.0, and as suggested by other authors to encapsulate research [, ], we decided to use the term Medicine 2.0. However, choosing either term would not have highly impacted the results of the literature review. The ranking of the terms and the context of use in the pages that we analyzed suggested the following definition for Medicine 2.0:
Medicine2.0 is the use of a specific set of Web tools (blogs, Podcasts, tagging, search, wikis, etc) by actors in health care including doctors, patients, and scientists, using principles of open source and generation of content by users, and the power of networks in order to personalize health care, collaborate, and promote health education.
Supporting this are five salient or structuring themes that we more accurately define as follows:
- Participants: the different stakeholders in Medicine 2.0
- Method/tools: the manner by which Medicine 2.0 information is created and owned (eg, its accuracy from user generation, open source or ownership, and the use of specific tools such as wikis)
- Collaboration and practice: Medicine 2.0 as a tool to promote participant’s interests as a reader (staying informed) or to communicate and collaborate collectively for his or her own practice
- Medical education: Medicine 2.0’s educational use for the general public, training new health professionals, or ongoing education for specialists (different than collaboration and practice in its promotion of general skills, as opposed to examining and collaboration on a patient’s particular case)
- Personalized health: Medicine 2.0 as a mechanism to provide customized health care, such as connecting patients with rare conditions, and to improve an individual’s value from health care
Research Question 1: Definition
Can a clear definition of Medicine 2.0 be established across practitioner and academic literature that distinguishes this field from eHealth? Examining this question, we found common salient themes for both Health 2.0 and Medicine 2.0 that describe Web 2.0’s application to health. Its application to health and medicine is not as straightforward as the rule “Medicine 2.0 = Medicine + Web 2.0,” particularly in its emphasis on personalized health care and its participants (not observed in the Web 2.0’s democratized collaborations ). In addition, while we did not complete a systematic review of eHealth, previous publications have shown that the field emphasizes the “communicative foundations of eHealth and specif[ies] the use of networked digital technologies, primarily the Internet...for all stakeholder groups” [ ]. As such, neither the stakeholders nor the principal tool used (the Internet) distinguishes Medicine 2.0 from eHealth. However, the principles of open source, generation of content by users, the power of networks, personalized health care, and the focus on collaboration across all stakeholders are not always highlighted by eHealth and suggest that these fields have different emphasis.
In addition, earlier in this paper we highlighted the issue that the technology based view of Medicine 2.0 (ie, the use of Web 2.0–like tools) could not clearly distinguish eHealth from Medicine 2.0. For example, we could conclude that every Internet health search using Google becomes a Medicine 2.0 search as the search algorithm is based on user-generated links. However, our definition implies that this cannot be taken for granted as Google does not meet many criteria of the Medicine 2.0 definition. First, it is not open; users do not have transparency on the algorithm or the ability to change it. Second, users do not have an intention to collaborate using Google or to help Google when assigning a link within a page. Rather, Google has commercialized a feature of Internet collaboration for its search and has not created a Medicine 2.0 collaborative platform. Despite this, other authors have argued that Google is the quintessential Web 2.0 company  and its use of network effects and user generated content will mean it will probably remain across the eHealth and Medicine 2.0 gray boundary.
Applying this definition to the original set of articles identified via key word searches on health and Web 2.0, we found that fewer papers were associated with the field. One main driver was the fact that the search terms (eg, “Medicine 2.0”) often found identified papers that had no relevance to the subject, though we did not bottom at the root cause of this effect. Others were relevant to eHealth in general, but not Medicine 2.0. For example, the study “Influences, usage, and outcomes of Internet health information searching: multivariate results from the Pew surveys” by Rice  provides detailed analysis on the use of the Internet in relation to health, but it does not address Medicine 2.0 issues specifically. A few papers ended on a similar gray boundary to that demonstrated by Google, such as Tse et al [ ], and these were excluded from our review. This does not mean their findings are not relevant, but rather we found that the overall paper was not specific to Medicine 2.0 and should consequently be treated as an eHealth paper with potential implications for Medicine 2.0.
Finally, we noted that rapid saturation in coding was achieved to obtain the salient themes used online. And while we believe this reflects a certain amount of common language used by the Health 2.0 or Medicine 2.0 online community, this does not mean all relevant themes were identified. For instance, social networking is only encapsulated in the “power of networks,” even though some authors would identify this as a very important separate trend and term. As such, this definition only identifies core or salient themes, not excluding other concepts, as being part of Medicine 2.0. We believe any compact definition will have difficulty in precisely delineating its complete scope.
Research Question 2: Agreement
Is there agreement between online discussions and academic communities in their use of the term Medicine 2.0? If not, what does such divergence imply for future research? Regarding research question 2, we identified 56 articles in the research literature that covered four of the five major themes underpinning the Medicine 2.0 definition. In reviewing the literature and comparing it to prominent online themes, we found limited research into personalized health but did find extensive literature on methods and tools. We also noted potential overlaps with a separate body of research into open source health and a general call by authors for further research in specific areas.
Despite the fact that personalized or customized health is a key objective or benefit of Medicine 2.0 (based on online discussions such as those typified by ), no academic publications were found that focused extensively on this theme. Specifically, we believe researchers may need to look at how personalized online health care can evolve, such as the trade-offs between an active global site (with rich, regular but fairly uncustomized updates) versus a local site with very specific information to a regional context (but with less contributors and, hence, the risk of inaccuracy or less information).
By contrast, research responding to the tools and methods is the most extensive. In this theme, papers looked at the implications of a particular tool or method, such as the errors in user-generated content or the implications of open-source methods. For example, Deshpande and Jadad  offer an overview of the methods or drivers of Medicine 2.0, providing some support for our identified themes and definition. In addition to information inaccuracy and privacy, open-source methods have been widely studied within this theme relating to medical research. Examples can be categorized into two types: those that address the issues and benefits of a common license for the output of research (eg, [ , ]), and those that look at open-source methods to develop information technology tools for medical research (eg, [ , ]). However, open-source health is not subsumed by Medicine 2.0. The extensive literature on open source, such as the 3864 articles in PubMed as of February 2008, covers topics outside Medicine 2.0. For example, Hope [ ] explores technology licensing not connected with Internet use, as opposed to Yang et al [ ], who do consider a Medicine 2.0 open-source collaboration. As such, while Medicine 2.0 relies on open-source methods in health, and the topics overlap in areas, we believe care should be taken to view them as distinct research topics.
Overall, there is a call for research in many areas, and Potts  suggests that researchers are significantly behind trends in eHealth and, more specifically, in Medicine 2.0 tools such as the use of blogs and wikis. Potts argues that extensive research is required to close this gap, which is supported by other researchers’ calls for more evidence to understand best practice models in using Medicine 2.0 for medical education and practice [ - ].
In addition to this call for research, we would expect publications on Medicine 2.0 to continue to grow in this theme for two further reasons. First, Web 2.0 tools are constantly evolving, and hence the impact of new tools will continue to require assessment. Second, two major tensions or research discussions exist that will also require investigation: information inaccuracy, and information privacy and ownership. We return to these tensions in the discussion on research question 3, and detail them inalong with how papers responded to salient themes. Note that some papers investigate Medicine 2.0’s impact for various stakeholders (indicated by “various” in ), while others either touch on multiple themes or are difficult to classify (indicated by “over-arching or unclassified” in ).
|Salient Theme||Year||Author||Principle Participant||Tensions|
|Over-arching or unclassified||2006||Skiba ||Researchers/scientists||Field’s existence|
|2007||Manhattan Research ||Doctors||n/a|
|Ferguson ||Patients/public health||Doctor’s concerns|
Privacy and ownership
|2008||Eysenbach [, ]||Various||Field’s existence|
|Versel ||Various||Field’s existence|
|Guistini ||Various||Field’s existence|
|Tools and methods||2002||Burk ||Researchers/scientists||n/a|
|2003||Killion et al ||Researchers/scientists||n/a|
|2004||Boyle et al ||Researchers/scientists||n/a|
|2005||Boulos et al ||Various||n/a|
|2006||Boulos et al ||Various||Information inaccuracy|
|Boulos and Honda ||Various||n/a|
|Castel et al ||Various||n/a|
|Johnson et al ||Various||n/a|
|Barsky ||Medical librarians||n/a|
|Barsky ||Medical librarians||n/a|
|Barsky and Purdon ||Medical librarians||n/a|
|Karkalis and Koutsouris ||Patients/public health||Privacy and ownership|
|Esquivel et al ||Patients/public health||Information inaccuracy|
|2007||Boulos and Wheeler ||Various||n/a|
|Yang et al ||Researchers/scientists||n/a|
|Saval et al ||Doctors||n/a|
|Adams ||Patients/public health||n/a|
|Boulos and Burden ||Patients/public health||Privacy and ownership|
|Boulos et al ||Patients/public health||n/a|
|Van den Brekel ||Patients/public health||n/a|
|Barsky and Cho ||Medical librarians||n/a|
|Barsky and Guistini ||Medical librarians||n/a|
|Cho ||Medical librarians||n/a|
|Connor ||Medical librarians||n/a|
|2008||Eysenbach ||Patients/public health||Information inaccuracy|
|Collaboration and practice||2004||Eysenbach et al ||Patients/public health||n/a|
|Atreja et al ||Doctors||n/a|
|Navarro et al ||Patients/public health||n/a|
|2007||Bonniface et al ||Patients/public health||n/a|
|Steyn and de Wee ||Medical librarians||n/a|
|Mclean et al ||Doctors||n/a|
|Potts ||Researchers/scientists||Field’s existence|
|Medical education||2006||Goh ||Patients/public health||Doctor’s concerns|
|Boulos et al ||Various||n/a|
|2007||Heller et al ||Patients/public health||n/a|
|Crespo ||Patients/public health||n/a|
|Sandars and Schroter ||Medical students||Doctor’s concerns|
|Sandars and Haythornthwaite ||Medical students||n/a|
|2008||McGee ||Medical Students||n/a|
|Sandars ||Medical Students||Privacy and ownership|
Research Question 3: Tensions
What are the major tensions between the main stakeholders in Medicine 2.0 communities as identified by research? In relation to research question 3, four key areas of debate or tension between stakeholders were identified by our literature review:
- The field’s existence: The definition of Medicine 2.0 and its existence as a legitimate research field, which this paper addresses, is an overarching issue, but it mostly concerns researchers.
- Doctors’ concerns with patients’ use of Medicine 2.0, even if the information is accurate: This tension will mostly play out between doctors and patients in regular practice.
- Information inaccuracy and potential risks associated with inaccurate Medicine 2.0 information: While this will concern all participants, it will be researchers, doctors, and patients who will have to understand the risks and techniques involved.
- Privacy and ownership issues with Medicine 2.0–generated information: This may include such things as patient groups driving research agendas in addition to those sought by doctors and scientists.
The first main area of debate, an overarching theme, is related to the lack of agreement on what Web 2.0 is, and if it really exists . Studies have generated justification for the study of Web 2.0 by the sheer size of its participants and the number of people who recognize it as a concept [ ]. This debate has trickled into the Medicine 2.0 domain in discussions by people such as Skiba [ ] and is continued by speculation that terms such as Health 2.0 may be a fake “gold rush” [ ]. The situation is complicated further by authors introducing Web 3.0 for medicine, speculating that some Web 2.0 tools such as social bookmarking will become redundant [ ]. However, we believe people will continue to use Medicine 2.0 tools, and some researchers have argued that Medicine 2.0 and Health 2.0 may evolve into terms with relevance for different audiences, such as Medicine 2.0 as an academic and international focus, versus a business or consumer audience for Health 2.0 [ , ]. Our results neither confirm nor reject this hypothesis, but they do provide support for the idea that the terms currently have a high degree of overlap and that both are more complex than simply applying Web 2.0 to a health care context.
The second main debate surrounds collaboration and practice by doctors and patients. Separate to the issues of information inaccuracy, it encompasses resistance by some doctors to their patients’ use of Medicine 2.0. Their concerns arise from Medicine 2.0 causing unwanted behaviors in patients, such as not consulting a physician, consulting a physician too late, or coming to wrong conclusions about their disease management even if the information available to them online is accurate. The issue is not new and arose with eHealth. Ferguson  calls these doctors “e-Patient resistant clinicians” and suggests a sense of loss of control (and risk of being sued), paternalism, or lack of training driving these doctors’ behaviors. However, the issue is distinct in Medicine 2.0, where amplifying effects to this behavior are identified by certain authors, such as lack of training for doctors [ ] or the difficulty of advising patients on use of Medicine 2.0 tools [ ]. Overall, authors claim that doctors will need to recognize the emergence of Medicine 2.0 and that current training may not be sufficient to do so.
The third main discussion, based on the methods used to generate Medicine 2.0 information, is the risk of inaccurate online information. Misinformation has long been identified as a hazard of eHealth. However, studies have found little support for this concern . These studies pre-date the rapid expansion in Medicine 2.0 use. Looking more closely at Medicine 2.0–specific information, Esquivel [ ] notes the error and correction rate on an Internet-based cancer support group. The study found that most information was accurate and most false or misleading statements were rapidly corrected. Eysenbach [ ] also examined the impact of information accuracy and credibility in relation to eHealth and noted that that patients will tend to use both intermediated (experts, authorities) and distributed (ie, Medicine 2.0) information to make their health decisions, thereby reducing any risk from inaccurate online information generated by users. In addition, apomediaries or gatekeepers acting at the network or group level work as collaborative filtering processes for distributed information that help users navigate through the onslaught of information afforded by networked digital media, reducing information risk further [ , ]. However, despite this early evidence of low risk, many practitioners and researchers remain to be convinced. This is demonstrated by responses to articles on Medicine 2.0’s potential, such as “the consequences could be disastrous for any inexperienced trainee following the advice” [ ], or the need for authors to post a clarification after suggesting that Google could be used as a diagnostic tool [ ].
The fourth and final debate is related to the consequences of the methods used to generate Medicine 2.0 information. Authors note that in addition to accuracy of information, privacy, ethical, legal, and ownership issues are also critical due to the nature of health information [, ]. This applies not only to patients but to doctors who may use social networking sites for medical education and debate [ ]. They suggest that potential models of identity management and authorization schemes should also be investigated in the context of Medicine 2.0 research. Once again, this tends to accentuate eHealth trends such as noted by Ferguson [ ], who also highlights that those patient groups who run specific sites claim ownership over this data and are increasingly using it to influence the research agenda. Overall, new sources of health information are emerging via these methods, which will impact not only doctors who carry out research but could have potential implications for scientists working in the wider industry, such as pharmaceutical companies.
Our study has several limitations that warrant attention. Clear risks arise from using Google and other search engines to define Medicine 2.0. First, in step 3 of the method, Google’s PageRank system may only identify popular self-referencing communities, which as noted by some researchers has bias against newer online content . Second, search algorithms are rarely published, and hence we cannot be sure of the consistency of the counts, which has been subject to criticism at low levels for both Google and MSN searches [ , ].
We mitigated the first risk via the iterative manner in which the definitions and themes were identified by comparing academic and online definitions for inconsistencies and by searching for theme rankings across all pages online to reduce the bias toward the popular pages. We did not find any major inconsistencies, even though the small differences in Medicine 2.0’s scope online and in academic publications were established. Examples include the online focus on personalized health and the lack of online focus on social networking, which has been identified as an important trend by other authors [, ]. Other exact phrases that we anticipated but did not see included “semantic Web.” To mitigate their potential omission, we determined their ranking anyway, but due to lower rankings, they would not have emerged in the defining text of top salient themes used in our paper. This does not indicate that these are not very important themes, but rather that they are covered in more general concepts such as the power of networks.
We also examined the specific criticisms, such as Google returning inconsistent results below 1000 counts or Microsoft Live Search being inconsistent below 8000 counts and hence only ranked exact phrases above these levels. However, the use of different search engines further emphasizes that only the top exact phrases (eg, Blog or Podcast rather than Mashup) can be used with confidence to identify the salient themes as there was good agreement between search engines. Hence, we mitigated this risk by only using the top two to three and commonly ranked phrases, avoiding the bias that a term has been ranked highly only due to a particular search engine’s internal mechanisms.
Following the updated definition of Medicine 2.0, the literature describes five major themes: (1) the participants involved; (2) the impact on different collaborations and practice; (3) the ability to provide personalized health care; (4) the use in medical education; (5) its associated methods and tools.
There is now an emerging body of research into Medicine 2.0; in addition to the 56 papers we identified that address it directly, there are also many eHealth papers that have indirect implications for Medicine 2.0. Overall, they suggest that Medicine 2.0 will have a large impact on all areas of medical practice. Most of these publications are recent, since 2004, and call for more empirical research on various topics.
We expect research to continue to focus on the four major tensions between stakeholders that were found in the literature: the scope of the field including its definition and existence, the patient-doctor relationships impacted by Medicine 2.0, the methods and tools relating to information accuracy, and the methods and tools related to ownership and privacy. These issues are also found in eHealth; however, Medicine 2.0 is accentuating their impact. While touched on by some overarching publications, the lack of research into personalized health does not indicate that its importance is overstated by online discussions. Rather, we concur with other researchers who suggest that research currently lags behind practice in understanding the implications of Medicine 2.0.
Conflicts of Interest
- O’Reilly T. What is Web 2.0. Design patterns and business models. O’Reilly Media. 2005. URL: http://www.oreillynet.com/pub/a/oreilly/tim/news/2005/09/30/what-is-web-20.html [accessed 2008 Feb 08] [WebCite Cache]
- McFredries P. Technically Speaking The Web, Take Two. IEEE Spectrum 2006;43(6). [CrossRef]
- O’Reilly T. Web 2.0 compact definition: trying again. radar.oreilly.com. 2006. URL: http://radar.oreilly.com/archives/2006/12/web-20-compact-definition-tryi.html [accessed 2008 Feb 22] [WebCite Cache]
- Giustini D. How Web 2.0 is changing medicine. BMJ 2006 Dec 23;333(7582):1283-1284 [FREE Full text] [Medline] [CrossRef]
- Sandars J, Schroter S. Web 2.0 technologies for undergraduate and postgraduate medical education: an online survey. Postgrad Med J 2007 Dec;83(986):759-762. [Medline] [CrossRef]
- Meattle J. Top 50 websites. Compete. 2007. URL: http://blog.compete.com/2007/10/30/top-50-websites-domains-digg-youtube-flickr-facebook/ [accessed 2008 Feb 07] [WebCite Cache]
- Tapscott D, Williams A. Wikinomics. New York: Penguin Group; 2006.
- von Hippel E. Democratizing Innovation. Cambridge, MA: MIT Press; 2005.
- Kerr C, Murray E, Stevenson F, Gore C, Nazareth I. Internet interventions for long-term conditions: patient and caregiver quality criteria. J Med Internet Res 2006 Jul;8(3):e13 [FREE Full text] [Medline] [CrossRef]
- Hope J. Open Source Biotechnology [dissertation]. Canberra, Australia: The Australian National University; 2005.
- PageRank (Google). Wikipedia. 2008. URL: http://en.wikipedia.org/wiki/PageRank [accessed 2008 Feb 11] [WebCite Cache]
- Strauss A, Corbin JM. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. Thousand Oaks, CA: Sage Publications; 1998.
- Hughes B, Wareham J. Democratized collaborations in big pharma. Paper to be presented at: 2008 Academy of Management Conference, Management of Technology and Innovation [advance publication]. URL: http://program.aomonline.org/2008/Session_Details.asp?print=true&SubmissionID=13754 [accessed 2008 May 12] [WebCite Cache]
- Cho J, Roy S. Impact of search engines on page popularity. Proceedings of the 13th international conference on World Wide Web. New York: ACM; 2004:20-29. [CrossRef]
- Cho J, Roy S, Adams RE. Page quality: in search of an unbiased web ranking. Proceedings of the 2005 ACM SIGMOD international conference on management of data. New York: ACM; 2005:551-562. [CrossRef]
- Vaughan L, Thelwall M. Search engine coverage bias: evidence and possible causes. Inf Process Manage 2004;40(4):693-707. [CrossRef]
- Hagelin EM. Coding data from child health records: the relationship between interrater agreement and interpretive burden. J Pediatr Nurs 1999 Oct;14(5):313-321. [Medline] [CrossRef]
- Berg BL. Qualitative Research Methods for the Social Sciences. Boston, MA: Allyn and Bacon; 2001.
- Notess G. Google inconsistencies. Search engine showdown. 2008. URL: http://www.searchengineshowdown.com/features/google/inconsistent.shtml [accessed 2008 Feb 22] [WebCite Cache]
- Thelwall M. Extracting accurate and complete results from search engines: case study Windows Live. J Am Soc Inf Sci Technol 2008;59(1):38. [CrossRef]
- Meskó B. Medicine 2.0. Science roll blog. 2008. URL: http://scienceroll.com/medicine-20/ [accessed 2008 Feb 07] [WebCite Cache]
- Medicine 2.0 #10 - medicine and the second generation of Internet. Highlight Health 2.0. 2008. URL: http://blog.highlighthealth.info/medicine-20/medicine-20-10-medicine-and-the-second-generation-of-internet-based-services/ [accessed 2008 Feb 07] [WebCite Cache]
- Web 2.0 in Medicine. Clinical cases and images. 2008. URL: http://casesblog.blogspot.com/2005/10/web-20-in-medicine.html [accessed 2008 Feb 11] [WebCite Cache]
- Castilla V. Medicine 2.0 blog carnival. Web 2.0 and Medicine Blog. 2008. URL: http://web2097.blogspot.com/2007/11/medicine-20-blog-carnival.html [accessed 2008 Feb 11] [WebCite Cache]
- Castilla V. Medicine 2.0: copyright or creative commons? 2008. Web 2.0 and Medicine Blog. 2008. URL: http://web2097.blogspot.com/ [accessed 2008 Feb 11] [WebCite Cache]
- Web 2.0 could be used in health e-learning. eHealth Insider. 2008. URL: http://www.e-health-insider.com/news/item.cfm?ID=2101 [accessed 2008 Feb 11] [WebCite Cache]
- Sharp J. Web 2.0: beyond open source in health care. Clinical cases and images blog. 2008. URL: http://casesblog.blogspot.com/2007/06/presentation-on-web-20-in-health-care.html [accessed 2008 Feb 11] [WebCite Cache]
- Web 2.0 and health care services. Headshift. 2008. URL: http://www.headshift.com/archives/003192.cfm [accessed 2008 Feb 11] [WebCite Cache]
- Health Care and Web 2.0. Dental Information and Library Innovations. 2008. URL: http://mblog.lib.umich.edu/dentlib/archives/2006/12/health_care_and.html [accessed 2008 Feb 11] [WebCite Cache]
- MacManus R. A Health 2.0 overview, through the eyes of a new diabetic. Read Write Web. 2008. URL: http://www.readwriteweb.com/archives/health_20_overview_diabetes_web.php [accessed 2008 Feb 11] [WebCite Cache]
- Web 2.0 - Do people in health get it? Tech 'N' Health. 2008. URL: http://technhealth.blogspot.com/2007/07/web-2.html [accessed 2008 Feb 11] [WebCite Cache]
- Barsky E, Cho A. Introducing Web 2.0: social search for health librarians. J Can Health Libr Assoc 2007;28(2):58-61.
- Barsky E, Giustini D. Introducing Web 2.0: wikis for health librarians. J Can Health Libr Assoc 2007;28(4):147-150.
- Gruber F. I need a medic! A Health 2.0 round-up. Somewhat Frank. 2008. URL: http://www.somewhatfrank.com/2007/11/i-need-a-medic.html [accessed 2008 Feb 11] [WebCite Cache]
- Eysenbach G. Medicine 2.0 Congress website launched (and Definition of Medicine 2.0 / Health 2.0). Gunther Eysenbach’s Random Research Rants. 2008. URL: http://gunther-eysenbach.blogspot.com/2008/03/medicine-20-congress-website-launched.html [accessed 2008 Mar 07] [WebCite Cache]
- Eysenbach G. Medicine 2.0: social networking, collaboration, participation, apomediation, and openness. J Med Internet Res 2008;10(3):e22 (forthcoming). [CrossRef]
- Pagliari C, Sloan D, Gregor P, Sullivan F, Detmer D, Kahan JP, et al. What is eHealth (4): a scoping exercise to map the field. J Med Internet Res 2005 Mar 31;7(1):e9 [FREE Full text] [Medline] [CrossRef]
- Tang H, Ng JHK. Googling for a diagnosis--use of Google as a diagnostic aid: internet based study. BMJ 2006 Dec 2;333(7579):1143-1145 [FREE Full text] [Medline] [CrossRef]
- Rice RE. Influences, usage, and outcomes of Internet health information searching: multivariate results from the Pew surveys. Int J Med Inform 2006 Jan;75(1):8-28. [Medline] [CrossRef]
- Tse MMY, Lo LWL, Chan MF. The use of health technology and information: e-learning technological approach. Cyberpsychol Behav 2007 Dec;10(6):821-826. [Medline] [CrossRef]
- Hamilton D. Perspective: personalizing medicine in the age of Health 2.0. Venturebeat.com. URL: http://venturebeat.com/2007/09/20/perspective-personalizing-medicine-in-the-age-of-health-20/ [accessed 2008 May 08] [WebCite Cache]
- Deshpande A, Jadad A. Web 2.0: could it help move the health system into the 21st century? J Men’s Health Gender 2006;3(4):332-336. [CrossRef]
- Burk D. Open source genomics. J Sci Technol Law 2002;8:254.
- Killion PJ, Sherlock G, Iyer VR. The Longhorn Array Database (LAD): an open-source, MIAME compliant implementation of the Stanford Microarray Database (SMD). BMC Bioinformatics 2003 Aug 20;4(4):32 [FREE Full text] [Medline] [CrossRef]
- Boyle EI, Weng S, Gollub J, Jin H, Botstein D, Cherry JM, et al. GO::TermFinder--open source software for accessing Gene Ontology information and finding significantly enriched Gene Ontology terms associated with a list of genes. Bioinformatics 2004 Dec 12;20(18):3710-3715 [FREE Full text] [Medline] [CrossRef]
- Yang IS, Ryu C, Cho KJ, Kim JK, Ong SH, Mitchell WP, et al. IDBD: infectious disease biomarker database. Nucleic Acids Res 2008 Jan;36(Database issue):D455-D460 [FREE Full text] [Medline] [CrossRef]
- Potts HWW. Is e-health progressing faster than e-health researchers? J Med Internet Res 2006;8(3):e24 [FREE Full text] [Medline] [CrossRef]
- Kamel Boulos MN, Wheeler S. The emerging Web 2.0 social software: an enabling suite of sociable technologies in health and health care education. Health Info Libr J 2007 Mar;24(1):2-23. [Medline] [CrossRef]
- Karkalis GI, Koutsouris DD. E-health and the Web 2.0. Paper presented at: The International Special Topic Conference on Information Technology in Biomedicine; October 26-28, 2006; Greece 2006.
- McLean R, Richards BH, Wardman JI. The effect of Web 2.0 on the future of medical practice and education: Darwikinian evolution or folksonomic revolution? Med J Aust 2007 Aug 6;187(3):174-177 [FREE Full text] [Medline]
- Boulos MNK, Maramba I, Wheeler S. Wikis, blogs and podcasts: a new generation of Web-based tools for virtual collaborative clinical practice and education. BMC Med Educ 2006 Aug 15;6(1):41 [FREE Full text] [Medline] [CrossRef]
- Skiba DJ. Web 2.0: next great thing or just marketing hype? Nurs Educ Perspect 2006 Jul;27(4):212-214. [Medline]
- White paper: physicians and Web 2.0: 5 things you should know about the evolving online landscape for physicians. 2007. Manhattan Research, LLC. 2007. URL: http://www.manhattanresearch.com/files/PRESS/Physicians_and_Web_2.0_from_Manhattan_Research.pdf [accessed 2008 Jan 22] [WebCite Cache]
- Ferguson T. ePatients white paper. www.e-patients.net. URL: http://www.e-patients.net/e-Patients_White_Paper.pdf [accessed 2008 Jan 22] [WebCite Cache]
- Versel N. Health 2.0. Will its promise be realized? Manag Care 2008 Mar;17(3):49-52. [Medline]
- Giustini D. Web 3.0 and medicine. BMJ 2007 Dec 22;335(7633):1273-1274. [Medline] [CrossRef]
- Boulos MNK. Web GIS in practice III: creating a simple interactive map of England's Strategic Health Authorities using Google Maps API, Google Earth KML, and MSN Virtual Earth Map Control. Int J Health Geogr 2005 Sep 21;4:22 [FREE Full text] [Medline] [CrossRef]
- Boulos MNK, Honda K. Web GIS in practice IV: publishing your health maps and connecting to remote WMS sources using the Open Source UMN MapServer and DM Solutions MapLab. Int J Health Geogr 2006 Jan 18;5(1):6 [FREE Full text] [Medline] [CrossRef]
- Castel JM, Figueras A, Vigo JM. The internet as a tool in clinical pharmacology. Br J Clin Pharmacol 2006 Jun;61(6):787-790 [FREE Full text] [Medline] [CrossRef]
- Johnson KR, Freeman SR, Dellavalle RP. Wikis: the application of Web 2.0. Arch Dermatol 2007 Aug;143(8):1065-1066. [Medline] [CrossRef]
- Giustini D. Top five (5) podcasting articles in medicine. UBC Academic Search - Google Scholar blog. URL: http://weblogs.elearning.ubc.ca/googlescholar/archives/023989.html [accessed 2008 Jul 22] [WebCite Cache]
- Barsky E. Introducing web 2.0: weblogs and podcasting for health librarians. JCHLA/JSBSC 2006;27:33-34.
- Barsky E. Introducing Web 2.0: RSS trends for health librarians. J Can Health Lib Assoc 2006;27:7-8.
- Barsky E, Purdon M. Introducing Web 2.0: social networking and social bookmarking for health librarians. J Can Health Libr Assoc 2006;27:65-67.
- Esquivel A, Meric-Bernstam F, Bernstam EV. Accuracy and self correction of information received from an internet breast cancer list: content analysis. BMJ 2006 Apr 22;332(7547):939-942 [FREE Full text] [Medline] [CrossRef]
- Liesegang TJ. Web 2.0, library 2.0, physician learning 2.0. Ophthalmology 2007 Oct;114(10):1801-1803. [Medline] [CrossRef]
- Savel RH, Goldstein EB, Perencevich EN, Angood PB. The iCritical care podcast: a novel medium for critical care communication and education. J Am Med Inform Assoc 2007 Jan;14(1):94-99 [FREE Full text] [Medline] [CrossRef]
- Adams SA. Using blogging tools to help individuals record their experiences: an exploration and review of two commercial web applications in the Netherlands. Stud Health Technol Inform 2007;130:193-203. [Medline]
- Boulos MNK, Burden D. Web GIS in practice V: 3-D interactive and real-time mapping in Second Life. Int J Health Geogr 2007 Nov 27;6:51 [FREE Full text] [Medline] [CrossRef]
- Boulos MNK, Hetherington L, Wheeler S. Second Life: an overview of the potential of 3-D virtual worlds in medical and health education. Health Info Libr J 2007 Dec;24(4):233-245. [Medline] [CrossRef]
- van den Brekel AJP. Get your consumer health information from an avatar!: health and medical related activities in a virtual environment. Paper presented at: European Association for Health Information & Libraries Workshop 2007; September 12-15, Krakow, Poland 2007 [FREE Full text] [WebCite Cache]
- Cho A. An introduction to mashups for health librarians. J Can Health Libr Assoc 2007;28(1):19-22.
- Connor E. Medical librarian 2.0. Med Ref Serv Q 2007 Dec;26(1). [Medline]
- Eysenbach G. Credibility of health information and digital media: new perspectives and implications for youth. In: Metzger MJ, Flanagin AJ, editors. Digital Media, Youth, and Credibility. The John D and Catherine T MacArthur Foundation Series on Digital Media and Learning. Cambridge, MA: MIT Press; 2008. URL: http://www.mitpressjournals.org/doi/pdf/10.1162/dmal.9780262562324.123 [CrossRef]
- Eysenbach G, Powell J, Englesakis M, Rizo C, Stern A. Health related virtual communities and electronic support groups: systematic review of the effects of online peer to peer interactions. BMJ 2004 May 15;328(7449):1166 [FREE Full text] [Medline] [CrossRef]
- Atreja A, Messinger-Rapport B, Jain A, Mehta N. Using Web 2.0 technologies to develop a resource for evidence based medicine. AMIA Annu Symp Proc 2006:847 [FREE Full text] [Medline]
- Navarro A, Voetsch K, Liburd L, Bezold C, Rhea M. Recommendations for future efforts in community health promotion: report of the National Expert Panel on Community Health Promotion. Atlanta, GA: Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Division of Adult and Community Health; 2006.
- Altmann U. Representation of Medical Informatics in the Wikipedia and its Perspectives. Stud Health Technol Inform 2005;116:755-760. [Medline]
- Bonniface L, Green L. Finding a new kind of knowledge on the HeartNET website. Health Info Libr J 2007 Dec;24 Suppl 1:67-76. [Medline] [CrossRef]
- Steyn C, de Wee JA. The naked librarian: health librarians in the modern era. Libr Rev 2007;56(9).
- Goh SH. The internet as a health education tool: sieving the wheat from the chaff. Singapore Med J 2006 Jan;47(1):3-5 [FREE Full text] [Medline]
- Kamel Boulos MN, Harvey FE, Roudsari AV, Bellazzi R, Hernando ME, Deutsch T, et al. A proposed semantic framework for diabetes education content management, customisation and delivery within the M2DM project. Comput Methods Programs Biomed 2006 Sep;83(3):188-197. [Medline] [CrossRef]
- Heller R. Capacity building for public health using the Internet. Bulletin of the World Health Organization 2007. [CrossRef]
- Crespo R. Virtual community health promotion. Prev Chronic Dis 2007 Jun 15;4(3):A75 [FREE Full text] [Medline]
- Skiba DJ. Nursing education 2.0: are Mashups useful for nursing education? Nurs Educ Perspect 2007 Sep;28(5):286-288. [Medline]
- Skiba DJ. Nursing education 2.0: Poke me. Where's your face in space? Nurs Educ Perspect 2007 Jul;28(4):214-216. [Medline]
- Skiba DJ. Nursing education 2.0: second life. Nurs Educ Perspect 2007 May;28(3):156-157. [Medline]
- Skiba DJ. Nursing education 2.0: YouTube. Nurs Educ Perspect 2007 Mar;28(2):100-102. [Medline]
- Sandars J, Haythornthwaite C. New horizons for e-learning in medical education: ecological and Web 2.0 perspectives. Med Teach 2007 May;29(4):307-310. [Medline] [CrossRef]
- McGee JB, Begg M. What medical educators need to know about "Web 2.0". Med Teach 2008 Mar;30(2):164-169. [Medline] [CrossRef]
- Sandars J, Homer M, Pell G, Croker T. Web 2.0 and social software: the medical student way of e-learning. Med Teach 2008 Feb 14:1-5. [Medline] [CrossRef]
- Skiba B, Tamas A, Robinson K. Web 2.0: hype or reality...and how will it play out? A strategic analysis. Arma Partners. 2006. URL: http://www.armapartners.com/files/admin/uploads/W17_F_1873_8699.pdf [accessed 2008 May 1] [WebCite Cache]
- Crocco AG, Villasis-Keever M, Jadad AR. Analysis of cases of harm associated with use of health information on the internet. JAMA 2002 Jun 5;287(21):2869-2871 [FREE Full text] [Medline]
Edited by G Eysenbach; submitted 29.02.08; peer-reviewed by H Potts, D Skiba, C Paton, H Oh; comments to author 17.04.08; revised version received 13.05.08; accepted 03.06.08; published 06.08.08
© Benjamin Hughes, Indra Joshi, Jonathan Wareham. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 06.08.2008. Except where otherwise noted, articles published in the Journal of Medical Internet Research are distributed under the terms of the Creative Commons Attribution License (http://www.creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided 1) the original work is properly cited, including full bibliographic details and the original article URL on www.jmir.org, and 2) this statement is included.