JMIR Publications

Journal of Medical Internet Research

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 15.10.14 in Vol 16, No 10 (2014): October

This paper is in the following e-collection/theme issue:

    Original Paper

    What Are Health-Related Users Tweeting? A Qualitative Content Analysis of Health-Related Users and Their Messages on Twitter

    1Johns Hopkins Bloomberg School of Public Health, Department of Health Policy & Management, Baltimore, MD, United States

    2Johns Hopkins Berman Institute of Bioethics & Division of General Internal Medicine, Baltimore, MD, United States

    3Johns Hopkins University, Human Language Technology Center of Excellence, Baltimore, MD, United States

    4Johns Hopkins University School of Medicine, Department of Psychiatry and Behavioral Sciences, Baltimore, MD, United States

    Corresponding Author:

    Joy L Lee, MS

    Johns Hopkins Bloomberg School of Public Health

    Department of Health Policy & Management

    624 North Broadway

    Baltimore, MD, 21295

    United States

    Phone: 1 978 319 3618

    Fax:1 410 955 0470

    Email:


    ABSTRACT

    Background: Twitter is home to many health professionals who send messages about a variety of health-related topics. Amid concerns about physicians posting inappropriate content online, more in-depth knowledge about these messages is needed to understand health professionals’ behavior on Twitter.

    Objective: Our goal was to characterize the content of Twitter messages, specifically focusing on health professionals and their tweets relating to health.

    Methods: We performed an in-depth content analysis of 700 tweets. Qualitative content analysis was conducted on tweets by health users on Twitter. The primary objective was to describe the general type of content (ie, health-related versus non-health related) on Twitter authored by health professionals and further to describe health-related tweets on the basis of the type of statement made. Specific attention was given to whether a tweet was personal (as opposed to professional) or made a claim that users would expect to be supported by some level of medical evidence (ie, a “testable” claim). A secondary objective was to compare content types among different users, including patients, physicians, nurses, health care organizations, and others.

    Results: Health-related users are posting a wide range of content on Twitter. Among health-related tweets, 53.2% (184/346) contained a testable claim. Of health-related tweets by providers, 17.6% (61/346) were personal in nature; 61% (59/96) made testable statements. While organizations and businesses use Twitter to promote their services and products, patient advocates are using this tool to share their personal experiences with health.

    Conclusions: Twitter users in health-related fields tweet about both testable claims and personal experiences. Future work should assess the relationship between testable tweets and the actual level of evidence supporting them, including how Twitter users—especially patients—interpret the content of tweets posted by health providers.

    J Med Internet Res 2014;16(10):e237

    doi:10.2196/jmir.3765

    KEYWORDS



    Introduction

    Close to 90% of US adults use the Internet [1]; 72% of those visit social media websites [2]. In fact, 12% of Internet users access social media to research health issues [3]. In particular, the micro-blogging service Twitter, which enables users to send short messages no more than 140 characters in length (see Figure 1 for the breakdown of a tweet), has quickly grown in popularity, with an estimated 255 million users monthly and 22% of active accounts based in the United States [4].

    Health providers, patients, and patient advocates comment on a diverse array of topics on Twitter [5-7]. Previous reports have examined discrete health topics that users are discussing on Twitter [8-10], as well as concerns related to medical professionalism [11,12]. Health researchers have also used Twitter as a tool to track disease outbreak [13,14] and recruit study subjects [15]. However, little in-depth knowledge is available about health-related content by health professionals on Twitter, in particular whether such content represents personal opinion, a claim that those who view the tweet would expect to be supported by rigorous evidence, or something else. In addition, despite recent controversy over whether physicians should separate their “personal” and “professional” identities online [16-18], little is known regarding health professionals’ actual behavior.

    Filling these knowledge gaps requires investigating message content at a depth only possible through qualitative analysis of health professionals’ tweets. This paper reports the results of a content analysis of such tweets. The primary objective of the study was to describe the general types of content on Twitter authored by health professionals, focusing on health-related content. Key content types of interest included content that would be perceived as “personal” and content that users would expect to be supported by medical evidence (ie, “testable” claims about health). Secondary objectives included comparisons of content areas by user type (eg, providers, health advocates). Based on prior experience and existing professional guidelines, it was hypothesized that self-identified health professionals would not post personal content on Twitter and that testable claims would be rare.

    Figure 1. Anatomy of a tweet.
    View this figure

    Methods

    Data Collection

    Data collection occurred in three basic steps. First, health users of Twitter were identified. Lists of Twitter users created by Organized Wisdom [19], a company in the health information technology sector, were used to gather data. Organized Wisdom collates health-related Twitter users into lists that enable others to more efficiently find information online; for example, the “doctors verified” list consists of physicians who openly disclose their credentials online. Of these lists, 37 are Twitter accounts for doctors, nurses, hospitals, and other health organizations that cover seven user groups of interest: health advocates, businesses, health care organizations, government organizations, students, professionals, and other (eg, health care-related publications).

    Second, from these health users, an equal number (n=200) of the most recent publicly available tweets for each user in each group, including retweets, was downloaded during the period July 31-August 3, 2012. In cases where users had fewer than 200 tweets, all available data were obtained.

    Third, from this large collection of tweets from the seven user groups, a smaller collection was sampled. For each group, a user from the group was randomly selected, and a random tweet (without replacement) was selected for that user. This strategy was used to create a preliminary sample of tweets (15 random tweets from each user group, or 105 total) to develop a coding scheme and a final sample for in-depth qualitative analysis (100 random tweets from each user group, or 700 total).

    Content Analysis

    The research team first hypothesized content areas of interest from their own experience and the published literature to generate a draft coding scheme. Then, using the preliminary sample of 105 tweets, 4 coauthors (JL, ZB, MD, MC) conducted content analyses of each tweet using this draft scheme. The coding scheme was then revised for the final analysis. The categories of interest are presented in Table 1. Subsequent analysis was then conducted on an additional 700 tweets as described above. Areas of disagreement between reviewer pairs were resolved by consensus in a case-by-case fashion. Reviewers were blind to the identity of the Twitter users during content analysis.

    Table 1. Categories of health-related tweets identified via content analysis (n=346; content frequency may be greater than 100% because content areas were not mutually exclusive).
    View this table

    After unmasking the data, users and user groups were reviewed to verify the accuracy of categories provided by Organized Wisdom. None of the tweets reviewed were found to be authored by the research team. In several instances, the provided categories were inaccurate; for example, a self-identified hotel was miscategorized as a government agency. Therefore, two members of the research team (JL and ZB) re-categorized all users into seven new user groups based on consensus review of publicly available profiles (Table 2): users without available profiles, non-health users, health advocates, health businesses, non-provider health professionals, health providers, and health care organizations. This resulted in a different number of tweets for each of the seven groups.

    Table 2. Types of users.
    View this table

    Statistical Analysis

    Descriptive statistics were used to tabulate types of tweets for each group of users. Statistically significant differences between the proportion of tweets among user groups were assessed using the chi-square test. Stata 13 was used for the analysis.

    This study was reviewed and declared exempt from further review by the Johns Hopkins Medicine Institutional Review Board.


    Results

    Tweets Overall

    Of all tweets, 5.0% (35/700) non-English tweets were excluded. The remaining 95.0% (665/700) English-language tweets were analyzed in depth (Figure 2). A total of 255 unique users contributed to the 665 tweets. Of the tweets in the analytic sample, 52.0% (346/665) were categorized as health-related. For example, a tweet such as “RT @Username: Tai chi improves mood, quality of life for patients with systolic heart failure” was categorized as health-related. Each health-related tweet was thereafter sub-coded into at least one of six non-mutually exclusive categories, as defined by Table 1.

    Nearly one-third (31.1%, 207/665) of all tweets in the sample were personal in nature. Among personal tweets, 70.5% (146/207) were non-health related, whereas 29.5% (61/207) were health-related. This finding was statistically significant (P<.001).

    Figure 2. Inclusion and exclusion of tweets.
    View this figure

    Content Analysis of Health-Related Tweets

    The research team was most interested in health-related tweets. Just over half (53.2%, 184/346) of these tweets contained “testable” claims, defined as claims for which someone viewing the tweet might expect to be supported by medical evidence. An example of a testable tweet is shown in Table 1 (first row).

    Within health-related tweets, news was the second most frequent content category; 41.0% (142/346) of these tweets contained news. Over a quarter (26.9%, 93/346) contained reference to a commercial product or service, 17.6% (61/346) relayed a personal viewpoint or experience, and 17.1% (59/346) discussed wellness.

    Categories of Health-Related Tweets by User Type

    Overview

    The analysis also compared the types of health-related tweets made by each of the seven user groups. Many of the users generating non-English tweets (9/14) contributed English tweets as well. The characterization of the health-related tweets by each user group is as follows.

    No Profile

    For 7.5% (19/255) of users, contributing 5.1% (34/665) of tweets, the user profile could not be accessed. Of these tweets, 56% (19/34) had health-related content. Among health-related tweets, 68% (13/19) made testable claims. Because 32% (6/19) of tweets by this group were personal, some of these users may have been individuals.

    Non–Health-Related User

    During the analysis, it was noted by the research team that—although users in the health field were originally intentionally sampled using Organized Wisdom—about a quarter of the users in the analysis (62/255) were not affiliated with a health profession, organization, or mission. This was the largest user group in the sample and potentially represents a comparison group of non-health users. These users contributed 30.2% (201/665) of all tweets in the analysis and 16.8% (58/346) of health-related tweets.

    Non-health users tweeted more about wellness than health-related users: 33% vs health user average of 14%, P<.001; health users defined as all groups other than non–health-related users, including no profile, health providers, health-related businesses, non-provider health professionals, patient advocates, and organizations. More so than any other group, the majority of tweets by this group also included a link (86%, 50/58), and significantly fewer of those links were accessible by the research team (43%, vs health user average of 80%, P<.001). Of all tweets by these users, 55% (32/58) had a testable claim and 47% (27/58) were news.

    Health Providers

    Direct-care providers, such as physicians and nurses, encompassed the next largest group of users, accounting for 23.1% (59/255) of the analytic sample. These users contributed 14.4% (96/665) of tweets analyzed; 61.5% (59/96) of tweets by these users were health-related in nature. They shared testable claims and news (61%, 36/59 and 56%, 33/59 respectively) more than other groups of individual users, although 14% (8/59) also mentioned a commercial product or service and 17% (10/59) were personal (eg, “That awkward moment when there is no awkward moment to tweet about”).

    Health-Related Businesses

    About one-fifth of the users (21.6%, 55/255) in the analysis were health-related businesses whose health-related tweets constituted 28.6% (99/346) of the analytic sample. Many tweets by health businesses (44%, 44/99) mentioned a product or service, the highest percentage among the categories of users. Aside from these commercially oriented tweets, businesses often shared information seemingly relevant to their market (eg, “When You Leave Someone with a Mental Illness” from an addiction center or “#Pharma cos. push for social-media rules #hcsm #hcmktg #web20” from a marketing agency). These users also had significantly more tweets that were personal in content (8% vs health user average of 19%, P=.003) than other health users.

    Non-Provider Health Professionals

    Non-provider health professionals are those in health care professions who do not provide direct patient care. Non-provider professionals made up 11.0% (28/255) of users in the sample, including two medical students; 12.4% (43/346) of total health tweets came from this group. The two medical students contributed nearly half of the tweets in this group (47%, 20/43). Only 49% (43/87) of tweets by this group of users were health-related, which was the lowest percentage among health users. This group of users made the fewest testable claims and referenced the news the least in their health tweets as compared to all other user groups. Instead, nearly half of the content (44%, 19/43) was about the users’ personal experiences. Among the two medical students, 70% (14/20) of health tweets were personal in nature. At the same time, this group of users also tweeted less about commercial products or services compared to any other group.

    Patient Advocates

    Patient advocates made up 6.3% (16/255) of the users in our analysis, and together they contributed 6% (45/665) of tweets. More than half (58%, 26/45) of tweets by these users were health-related; 38% (10/26) of the users’ health-related tweets were personal in nature, the second-highest number of personal tweets among the groups. Only 8% (2/26) of health tweets by this group touched upon wellness, which was below the average of 14%. Many of the messages retweeted content from other users, and 85% (22/26) included a link.

    Organizations

    Health care organizations represented in this sample were hospitals, medical societies, health care clinics, and journals. These users represented 5% of our sample and contributed 7.7% (51/665) of tweets. More than half (82%, 42/51) of their tweets were health-related. Moreover, these health tweets were most likely to share “testable” claims than other users. The majority of organizations’ tweets contained testable claims (64%, 27/42) and news (52%, 22/42), and few were personal in nature (7%, 3/42). Yet organizations also had a high number of commercial tweets; a third of their health tweets (33%, 14/42) advertised a commercial product, or most often, their own services (eg, CPR courses, lab tests, and staff education curriculum).

    Like tweets by patient advocates, tweets by health care organizations often passed on information through links. Most of their links (91%, 32/35) were accessible, compared to an overall average of 72% (P=.04).

    Group Comparisons

    Table 3 summarizes the distribution of tweet content areas among user groups, where content by health providers serves as the baseline for comparison. Overall, there were no significant differences in the types of content between health providers and non-health users and those without available profiles.

    Health advocates tweeted about personal health matters significantly more than providers. Provider tweets were most different from those of health care businesses. Businesses were statistically more likely to tweet about news and less likely to tweet about wellness, and non-provider health professionals were statistically more likely to tweet testable claims and news stories and less about personal content. The tweets of health care organizations and providers differed as well. Organizations’ tweets were statistically more likely to include commercial content and wellness but were less likely to include personal content.

    Table 3. Percentage of health-related tweets in selected content areas by user group.
    View this table

    Discussion

    Principal Results

    This analysis of self-identified health users and their health-related messages on Twitter identified several important findings. First, over half of the tweets in the sample included tweets with testable claims, defined for this study as content that a Twitter user might expect to be supported by medical evidence. The majority of health tweets were testable and comprised various topics. In a preliminary analysis, we found that about 40% of such testable tweets shared medical advice while 23% disseminated scientific news or research books and articles. Although the research team did not analyze this in detail, the sources behind these medical claims were more varied than scientific research (ie, “evidence-based” medicine claims), ranging from common sense (eg, advice to drink more water on a hot day) to WebMD to Dr. Oz to personal blogs. Whether the claims were actually scientifically valid was not examined and requires further study.

    Second, in addition to traditional providers, a wide range of non-health providers are sending health-related tweets. Moreover, the content of tweets by health-related users on Twitter varied with user type. Health care organizations, for example, shared more health news and testable claims than individuals but also endorsed commercial services or products more than individuals. In the future, it could be important to examine whether organizations’ tweets are based more often in rigorous evidence as compared to those of individual health professionals. These findings confirm and expand upon the work of Sugawara et al [20] and Chretien et al [21], who both focused on a subset of health users. In examining the tweets of cancer patients in Japan, Sugawara found that patients tweeted about both personal (eg, greetings, chats) and medical matters (eg, information about treatments). Similarly, Chretien found that health providers (specifically, physicians) shared personal, commercial, as well as medical information over Twitter.

    We found that 17% of users in this sample were non-provider individuals in the health field, together contributing 20% of health-related tweets. Their participation illustrates the wide range of non-providers engaging in information sharing and health messaging on Twitter. While this community of users represents a significant resource of health conversation and information on Twitter, these non-providers are not bound by professional guidelines on Twitter use. It is unclear how Twitter users might use or understand the tweets of this group compared, for example, to tweets by physicians and nurses. Given that trust is a significant feature of social networks (with young users potentially trusting their social network as much as physicians), this requires further examination [3,22].

    Third, these findings demonstrate potential gaps between professional guidelines and online behavior [23,24]. Many medical societies, institutions, and medical schools disseminate such guidelines for clinicians and students. Often, these guidelines encourage the use of social media as a tool for endorsing medical information, discourage using the medium for medical consults, and counsel against posting personal content. Despite this, 17% of health tweets from providers and 74% from medical students included personal content. This lack of adherence to professional guidelines identifies an area where additional education or potentially consensus building within the profession is needed. Similarly, the sizable minority (14%) of providers’ tweets that included commercial products or services confirms prior findings and concerns about potential conflicts of interest on Twitter (a medium where disclosure is difficult, if not impossible) [21,25].

    As the use of Twitter has increased, so has the scholarship on the use of Twitter for health-related purposes. Some researchers have used Twitter as a surveillance [7,13,26] and prediction tool for disease outbreak [27] while others have characterized the relationship between segments of health-related users on Twitter, such as medical societies [28], internal medicine physicians [29], and cancer patients [20]. Though few papers examined health-related users as a whole, or the content of their tweets in detail, ours is not the first content analysis of Twitter. For example, Chew and Eysenbach analyzed individual tweets relating to the 2009 H1N1 pandemic, finding that information from a variety of credible sources, in addition to opinions and experiences, were disseminated on Twitter [26]. Our study, a qualitative analysis of tweets from health-related users, addressed different questions and thus made use of a different approach.

    This study adds to the growing literature on using Twitter for health purposes by examining the content of tweets by health-related users. In doing so, this study had several important strengths. It represents an in-depth exploration of the types of health-related users and content on Twitter. The analysis is the first to examine in detail both health users and their health-related content on Twitter, orienting researchers and clinicians to the Twitter health landscape. While previous studies focused on Twitter use among certain populations or users [8,20,21,30,31] such as cancer patients in Japan, or certain topics such as childhood obesity [9], this study explored several types of users, achieving breadth and qualitative depth simultaneously.

    Limitations

    The study was not without limitations. Data collection occurred in the summer of 2012; this sample thus reflects a Twitter landscape that may have shifted since then. For example, adherence to professional guidelines could be expected to increase over time. This study’s findings set a baseline for future analyses. The selection of the analytic sample was limited by the absence of a simple mechanism to sample health-related users and tweets on Twitter. For this reason, it was not feasible to select a random sample of all health users and their tweets, reducing the generalizability of the study findings. Although Organized Wisdom, by organizing content into lists, seemed to offer a reasonable way to address this problem, many user category designations were inaccurate. Favoring accuracy of user type over preservation of the original categories, the research team undertook its own characterizations. Because this reduced the number of tweets in certain user groups, this reduced the ability to determine statistical significance between groups. If so, the results likely underestimate potential differences between groups. Importantly, this only reinforces the need for in-depth analysis while revealing a concern that collated “health-related user” content might not be from health-related users.

    The analysis did not purposely evaluate “high impact” users (eg, Dr. Oz, Atul Gawande, Sanjay Gupta). We also did not independently verify user profiles, and users representing themselves as providers were not checked against other databases. Furthermore, while the analysis was double coded and disagreements were resolved by consensus, the subjective nature of coding limits the validity of these findings.

    Future Considerations

    This study presents several opportunities for further research. While a preliminary assessment evaluated the evidence base of each testable tweet, future analysis could examine this subset of tweets (health-related tweets that contain testable claims), for example, by comparing them to accepted strength of evidence standards [32]. Cross-referencing the identities of the users would be another next step in refining the characterization of users, while including Twitter users who are verifiable, self-identified patients or providers would further enrich the analysis of health messages.

    Conclusions

    In conclusion, health-related users and the content they share on Twitter are diverse. While providers’ tweets often include testable claims, they also make use of personal statements. Non-providers also contribute to ongoing health-related messaging on Twitter. Users in health-related fields who are actively engaging in health-related conversations on Twitter, as well as those who are merely reading these users’ tweets, should be oriented to the diversity of health-related Twitter content, and, if possible, to the validity of associated tweets.

    Conflicts of Interest

    Dr DeCamp reports having received travel reimbursement from the American College of Physicians related to speaking on social media and medical professionalism. Dr Berger reports receiving compensation from the Johns Hopkins University School of Medicine for generating tweets as part of a medical education website.

    References

    1. Pew Research Center. Pew Research Center's Internet and American Life Project. 2014 Jan. Internet User Demographics   URL: http://www.pewinternet.org/data-trend/internet-use/latest-stats/ [accessed 2014-10-01] [WebCite Cache]
    2. Brenner J, Smith A. Pew Research Center Internet & American Life Project Tracking Survey. 2013 Apr. 72% of online adults are social networking site users   URL: http://www.pewinternet.org/2013/08/05/72-of-online-adults-are-social-networking-site-users/ [accessed 2014-10-01] [WebCite Cache]
    3. Fox S, Jones S. Pew Internet & American Life Project Survey. 2009. The social life of health information Internet   URL: http://www.pewinternet.org/files/old-media//Files/Reports/2009/PIP_Health_2009.pdf [accessed 2014-10-01] [WebCite Cache]
    4. Twitter. About page   URL: https://about.twitter.com/company [accessed 2014-10-01] [WebCite Cache]
    5. Paul MJ, Dredze M. You are what you Tweet: Analyzing Twitter for public health. 2011 Presented at: International Conference on Weblogs and Social Media; July 17-21, 2011; Barcelona, Spain.
    6. Mehta N, Flickinger T. The Times They Are A-Changin': Academia, Social Media and the JGIM Twitter Journal Club. J Gen Intern Med 2014 Oct;29(10):1317-1318. [CrossRef] [Medline]
    7. Freifeld CC, Brownstein JS, Menone CM, Bao W, Filice R, Kass-Hout T, et al. Digital drug safety surveillance: monitoring pharmaceutical products in twitter. Drug Saf 2014 May;37(5):343-350 [FREE Full text] [CrossRef] [Medline]
    8. Thackeray R, Neiger BL, Burton SH, Thackeray CR. Analysis of the purpose of state health departments' tweets: information sharing, engagement, and action. J Med Internet Res 2013;15(11):e255 [FREE Full text] [CrossRef] [Medline]
    9. Harris JK, Moreland-Russell S, Tabak RG, Ruhr LR, Maier RC. Communication about childhood obesity on Twitter. Am J Public Health 2014 Jul;104(7):e62-e69 [FREE Full text] [CrossRef] [Medline]
    10. Duke JC, Hansen H, Kim AE, Curry L, Allen J. The use of social media by state tobacco control programs to promote smoking cessation: a cross-sectional study. J Med Internet Res 2014;16(7):e169 [FREE Full text] [CrossRef] [Medline]
    11. Chretien KC, Farnan JM, Greysen SR, Kind T. To friend or not to friend? Social networking and faculty perceptions of online professionalism. Acad Med 2011 Dec;86(12):1545-1550. [CrossRef] [Medline]
    12. DeCamp M, Cunningham AM. Social media: the way forward or a waste of time for physicians? J R Coll Physicians Edinb 2013;43(4):318-322. [CrossRef] [Medline]
    13. Yom-Tov E, Borsa D, Cox IJ, McKendry RA. Detecting disease outbreaks in mass gatherings using Internet data. J Med Internet Res 2014;16(6):e154 [FREE Full text] [CrossRef] [Medline]
    14. Harris JK, Mansour R, Choucair B, Olson J, Nissen C, Bhatt J, Centers for Disease Control and Prevention. Health department use of social media to identify foodborne illness - Chicago, Illinois, 2013-2014. MMWR Morb Mortal Wkly Rep 2014 Aug 15;63(32):681-685 [FREE Full text] [Medline]
    15. Yuan P, Bare MG, Johnson MO, Saberi P. Using online social media for recruitment of human immunodeficiency virus-positive participants: a cross-sectional survey. J Med Internet Res 2014;16(5):e117 [FREE Full text] [CrossRef] [Medline]
    16. DeCamp M, Koenig TW, Chisolm MS. Social media and physicians' online identity crisis. JAMA 2013 Aug 14;310(6):581-582 [FREE Full text] [CrossRef] [Medline]
    17. Crotty BH, Mostaghimi A, Arora VM. Online identities of physicians. JAMA 2013 Dec 18;310(23):2566-2567. [CrossRef] [Medline]
    18. Lee JL, Wu AW. Online medical professionalism. Ann Intern Med 2013 Jul 16;159(2):158. [CrossRef] [Medline]
    19. OrganizedWisdom. About Us page. Saving Doctors Time While Creating Healthier, Happier Patients   URL: http://www.organizedwisdom.com/about_us/an/med [accessed 2014-10-01] [WebCite Cache]
    20. Sugawara Y, Narimatsu H, Hozawa A, Shao L, Otani K, Fukao A. Cancer patients on Twitter: a novel patient community on social media. BMC Res Notes 2012;5:699 [FREE Full text] [CrossRef] [Medline]
    21. Chretien KC, Azar J, Kind T. Physicians on Twitter. JAMA 2011 Feb 9;305(6):566-568. [CrossRef] [Medline]
    22. Ye Y. Correlates of consumer trust in online health information: findings from the health information national trends survey. J Health Commun 2011 Jan;16(1):34-49. [CrossRef] [Medline]
    23. Guseh JS, Brendel RW, Brendel DH. Medical professionalism in the age of online social networking. J Med Ethics 2009 Sep;35(9):584-586. [CrossRef] [Medline]
    24. Batt-Rawden S, Flickinger T, Weiner J, Cheston C, Chisolm M. The role of social media in clinical excellence. Clin Teach 2014 Jul;11(4):264-269. [CrossRef] [Medline]
    25. Decamp M. Physicians, social media, and conflict of interest. J Gen Intern Med 2013 Feb;28(2):299-303 [FREE Full text] [CrossRef] [Medline]
    26. Chew C, Eysenbach G. Pandemics in the age of Twitter: content analysis of Tweets during the 2009 H1N1 outbreak. PLoS One 2010;5(11):e14118 [FREE Full text] [CrossRef] [Medline]
    27. Nsoesie E, Mararthe M, Brownstein J. Forecasting peaks of seasonal influenza epidemics. PLoS Curr 2013;5:- [FREE Full text] [CrossRef] [Medline]
    28. Mishori R, Singh LO, Levy B, Newport C. Mapping physician Twitter networks: describing how they work as a first step in understanding connectivity, information flow, and message diffusion. J Med Internet Res 2014;16(4):e107 [FREE Full text] [CrossRef] [Medline]
    29. Desai T, Patwardhan M, Coore H. Factors that contribute to social media influence within an Internal Medicine Twitter learning community. F1000Res 2014;3:120 [FREE Full text] [CrossRef] [Medline]
    30. Himelboim I, Han JY. Cancer talk on twitter: community structure and information sources in breast and prostate cancer social networks. J Health Commun 2014;19(2):210-225. [CrossRef] [Medline]
    31. Tsuya A, Sugawara Y, Tanaka A, Narimatsu H. Do cancer patients tweet? Examining the twitter use of cancer patients in Japan. J Med Internet Res 2014;16(5):e137 [FREE Full text] [CrossRef] [Medline]
    32. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, GRADE Working Group. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008 Apr 26;336(7650):924-926 [FREE Full text] [CrossRef] [Medline]

    Edited by G Eysenbach; submitted 07.08.14; peer-reviewed by A Dijuricich, H Narimatsu; comments to author 10.09.14; revised version received 12.09.14; accepted 16.09.14; published 15.10.14

    ©Joy L Lee, Matthew DeCamp, Mark Dredze, Margaret S Chisolm, Zackary D Berger. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 15.10.2014.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.