JMIR Publications

Select Journals for Content Updates

When finished, please click submit.

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

This paper is in the following e-collection/theme issue:

    Original Paper

    A Novel Evaluation of World No Tobacco Day in Latin America

    1Children's Hospital Informatics Program in the Harvard-MIT Division of Health Sciences and Technology, Boston, MA, United States

    2Children's Hospital Boston, Boston, MA, United States

    3Harvard Medical School, Boston, MA, United States

    4Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States

    5Keck School of Medicine, University of Southern California, Los Angeles, CA, United States

    6Johns Hopkins School of Medicine, Baltimore, MD, United States

    7Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, United States

    8Lineberger Comprehensive Cancer Center, Chapel Hill, NC, United States

    Corresponding Author:

    John W Ayers, MA, PhD

    Children's Hospital Informatics Program in the Harvard-MIT Division of Health Sciences and Technology

    1 Autumn St

    Boston, MA, 02215

    United States

    Phone: 1 617 355 6000

    Fax:1 617 355 6998

    Email:


    ABSTRACT

    Background: World No Tobacco Day (WNTD), commemorated annually on May 31, aims to inform the public about tobacco harms. Because tobacco control surveillance is usually annualized, the effectiveness of WNTD remains unexplored into its 25th year.

    Objective: To explore the potential of digital surveillance (infoveillance) to evaluate the impacts of WNTD on population awareness of and interest in cessation.

    Methods: Health-related news stories and Internet search queries were aggregated to form a continuous and real-time data stream. We monitored daily news coverage of and Internet search queries for cessation in seven Latin American nations from 2006 to 2011.

    Results: Cessation news coverage peaked around WNTD, typically increasing 71% (95% confidence interval [CI] 61–81), ranging from 61% in Mexico to 83% in Venezuela. Queries indicative of cessation interest peaked on WNTD, increasing 40% (95% CI 32–48), ranging from 24% in Colombia to 84% in Venezuela. A doubling in cessation news coverage was associated with approximately a 50% increase in cessation queries. To gain a practical perspective, we compared WNTD-related activity with New Year’s Day and several cigarette excise tax increases in Mexico. Cessation queries around WNTD were typically greater than New Year’s Day and approximated a 2.8% (95% CI –0.8 to 6.3) increase in cigarette excise taxes.

    Conclusions: This novel evaluation suggests WNTD had a significant impact on popular awareness (media trends) and individual interest (query trends) in smoking cessation. Because WNTD is constantly evolving, our work is also a model for real-time surveillance and potential improvement in WNTD and similar initiatives.

    J Med Internet Res 2012;14(3):e77)

    doi:10.2196/jmir.2148

    KEYWORDS



    Introduction

    Tobacco is responsible for about 4 million premature deaths each year, mostly in developing countries [1] where smoking continues to find safe harbor [2]. Latin America has the seventh and third highest smoking-related mortality among men and women, respectively, in the 14 epidemiologic global regions [1]. Latin America’s share of smoking-attributable mortality will likely increase given the high prevalence of smoking: 43% of men and 23% of women smoke in Peru, 41% and 31% in Chile, 37% and 12% in Mexico, and 34% and 24% in Argentina, compared with 23% and 18% in the United States [3,4].

    Mandated by the World Health Assembly in 1987 and commemorated annually on May 31, World No Tobacco Day (WNTD) aims to inform the public about the global tobacco epidemic using a combination of mass media approaches, including television, radio, and the Internet [5]. WNTD is believed to be especially important in regions with limited resources for cessation campaigns [6,7] and limited (albeit rapidly changing) tobacco control policy provisions, like in Latin America [8-11]. However, nearing the 25th anniversary of WTND, its effectiveness remains unexplored.

    Because tobacco surveillance is typically annualized, it is exceedingly difficult to estimate the impact of a single awareness day [12]. In nearly all studies [13], investigators make comparisons using annual data from cross-sectional or cohort surveys before and after the intervention [14]; however, differences across the year may not be attributable to the intervention effect [15]. Sometimes investigators ask respondents in cross-sectional surveys to describe their exposure to an intervention, comparing those reporting exposure with those not reporting exposure [16]. Rarely, investigators use cross-sectional monthly survey responses to yield estimates on a finer temporal resolution [17], but these trends are costly to obtain and are still not useful for a single awareness day, given the primary effects are expected on a finer temporal resolution than months. Pioneering work in infodemiology and infoveillance provided a framework for how to assess WNTD’s potential effectiveness [18-23]. For instance, Twitter feeds presage cholera epidemics [24]; Internet search queries forecast dengue incidence [25]; and unstructured media reports provide the earliest alerts of disease outbreaks [26]. Building on this work, we employed a novel daily digital surveillance approach using freely available and public archives to estimate the effectiveness of WNTD in seven Latin American nations.

    We monitored both intermediate and primary outcomes. First, WNTD may promote cessation awareness through the promotion of smoking cessation in news media [13]. By monitoring online news archives for articles promoting cessation, we captured cessation awareness trends that may have been motivated by WNTD. Second, WNTD may encourage smokers to search the Web for cessation resources [27]. By monitoring aggregate Internet search queries indicative of cessation, we captured interest in cessation that may have been motivated by WNTD. WNTD increases in cessation awareness may trigger increases in cessation interest; therefore, we examined the relationship between cessation news coverage and Internet search queries for cessation.


    Methods

    To address the study objectives, we analyzed online news media promoting cessation and online search queries for cessation from 2006 to 2011 in Mexico, Colombia, Argentina, Peru, Venezuela, Chile, and Ecuador using a quasi-experimental design [15].

    We monitored weekly news stories archived on Google News that mentioned quitting smoking (Google Inc, Mountain View, CA, USA; news.google.com). Google News captures a broad spectrum of print, radio, and television media, and therefore is a useful archive to monitor cessation media stories. To identify the country of origin for each article, we downloaded data from nation-specific Google News domains (eg, news.google.com.mx for Mexico). All stories that mentioned smoking cessation were monitored relative to all stories in each nation. The numerator was the number of articles containing the phrase “dejar de fumar” (literally “give up smoking”), chosen based on discussion with experts and native Spanish speakers familiar with linguistic nuances across the nations monitored. The denominator was the number of stories that contained any universal conjunctive phrases, such as those containing “de,” thereby indicating a count of all stories. We report the resulting quotient per 100,000 stories.

    Aggregate query trends were downloaded from Google Insights for Search (www.google.com/insights/). We monitored all queries that included “dejar de fumar” by nation. Trends were analyzed on a relative search volume (RSV) scale, with queries normalized to the period with the highest search proportion—for example, RSV = 100 is the highest search proportion period (cessation queries versus all search queries), and RSV = 50 is 50% of the highest search proportion. This approach corrects for trending in absolute search volume that is usually increasing for all common queries [28].

    We analyzed data on weekly and daily time trends. Visual inspection of the data suggested the likely impact of WNTD was a pulse effect, an immediate change in mean news or query trends, rather than a durable shift. Because WNTD is a global program, there are no nations that may serve as untreated controls. As a result, we specified interrupted time series [29] within each nation to estimate the mean RSV around and including WNTD (3 weeks, including the week of, the week before, and the week after WNTD) to capture the rise and decline in WNTD spikes in reference to a within-nation RSV sampling from the 12 weeks before and after the WNTD period. The weeks before and after WNTD were included to capture presaging and lingering increases in news and search that was visually evident in the data inspection. We estimated the effect size as a ratio between WNTD and reference periods to make estimates comparable across nations (Ho:(RSVWNTD – RSVreference weeks)/RSVreference weeks = 0) [30]. To find the amount of variance in search queries explained by media trends, we regressed news trends lagged by 0, 1, and 2 weeks against search terms and reported r2 for all periods and after selecting only periods around WNTD [31].


    Results

    Figure 1 shows example cessation news coverage and cessation query trends in Mexico (patterns were similar in the six other study nations). Both news and query trends spiked in Mexico around WNTD. Averaging across years, cessation news trends typically peaked at 30 per 100,000 news stories the week of WNTD with cessation query trends peaking at 95% (RSV) of the highest search proportion week (with the highest RSV, 100, being on New Year’s Day 2008). Average trends across years (Figure 1B) suggested increases around WNTD were greater than the usual New Year’s spikes in Mexico. News and query peaks varied in their timing where there were strong buildups in news coverage beginning almost a month before WNTD, terminating 2 or 3 days after WNTD (Figure 1C), and queries had a pronounced peak around WNTD with queries remaining higher for a week after WNTD. Cessation news trends averaged 147 per 100,000 stories on WNTD, and queries had the highest search proportion day (RSV = 100) on WNTD.

    Statistical analysis suggested WNTD was associated with increases in cessation news coverage and cessation queries in all nations (Figure 2). Averaging across all nations and years suggested cessation news trends were 71% (95% confidence interval [CI] 61–81) higher and cessation query trends were 40% (95% CI 32–48) higher around WNTD than expected, as compared with trends 12 weeks before and after the WNTD period. Cessation news increases varied year to year, ranging from 24% (95% CI 18–30) to 116% (95% CI 103–128) for 2006 and 2009, respectively. Cessation query increases ranged from 28% (95% CI 21–36) to 50% (95% CI 43–57) for 2009 and 2008, respectively. Analyses by nation suggested news mentions of cessation ranged from 61% (95% CI 31–91) to 83% (95% CI 53–113) higher around WNTD in Mexico and Venezuela, respectively (Figure 3). Cessation queries ranged from 24% (95% CI 15–32) to 84% (95% CI 68–100) higher around WNTD in Argentina and Venezuela, respectively.

    Cessation news coverage explained limited amounts of variance in cessation queries. Multiple r2 ranged from .024 in Argentina to .516 in Mexico. Generally, cessation news coverage and cessation queries were not strongly associated across all time periods. However, the correlation between mean trends 3 months before to 3 months after WNTD was substantially higher (eg, r = .5 in Mexico). Figure 4 compares the magnitude of the effect sizes for search and news trend increases around WNTD by nation and year. Analyses showed increases in news trends (the week of, and before and after WNTD) were larger than increases in search query trends for nearly all the years, suggesting increases in cessation news coverage had diminishing returns on cessation queries during this narrow period. As such, a doubling in cessation news coverage corresponded with about a 50% increase in cessation queries.

    Increases in cessation news coverage and cessation queries around WNTD need to be placed in practical perspective. Cigarette excise tax increases are the most effective tobacco control policy [32]. Around New Year’s Day in 2007, 2008, 2009, and 2011, Mexico increased its cigarette excise tax 4.7%, 1.3%, 1.2%, and 7.8%, respectively. We compared increases in cessation news coverage and cessation queries around WNTD with those from these tax years. In Mexico, increases in cessation queries around New Year’s Day (compared with the WNTD baseline) were as little as 10% (95% CI 2–23). WNTD-related increases were typically much larger than New Year’s-related increases in absence of a tax increase and were sometimes greater than increases when a new tax increase was also implemented. Regressing tax increases against WNTD increases across years and predicting the result for the overall mean suggested that WNTD increases in cessation news coverage and query trends approximated those for a 2.8% (95% CI –0.8 to 6.3) cigarette excise tax increase. Additionally, the estimate is based on a small sample (6 years), so while it is qualitatively accurate, the effect of WNTD may be equivalent to a somewhat lower or higher tax, especially since all tax increases occurred in addition to any New Year’s effects.

    Figure 1. Example World No Tobacco Day (WNTD) time trends in Mexico, 2006-2011. (A) Entire series by week, (B) entire weekly series with mean annualized estimate, and (C) daily series with mean estimates. Daily query estimates were restricted to 2010 and 2011 due to data unavailability.
    View this figure
    Figure 2. Pooled estimates of World No Tobacco Day effectiveness in Latin America, 2006-2011. Estimates are made comparing the week of (and before and after) World No Tobacco Day with 12 weeks before and after that period.
    View this figure
    Figure 3. Nation-specific estimates of World No Tobacco Day effectiveness in Latin America, 2006-2011. Dotted line indicates average effect for all nations and years as a reference point. Data were unavailable in Ecuador, Chile, and Columbia for 2006 and 2007.
    View this figure
    Figure 4. Cessation news coverage is positively associated with cessation Internet search queries. Nodes are sized according to mean annual search query volume, with nodes by nation and year.
    View this figure

    Discussion

    We demonstrated the feasibility of novel digital surveillance for tobacco control, yielding the first population estimates of WNTD’s effectiveness in the first program evaluation to use digital surveillance. WNTD coincided with large increases in cessation news coverage and cessation Internet search queries in seven Latin American nations. WNTD increases eclipsed New Year’s Day increases and approximated the effectiveness of the combination of New Year’s and a 2.8% cigarette tax hike. There was little correlation between news trends and query trends when comparing across the entire time series, but higher correlation when comparing trends around WNTD. This may indicate that news plays a minor role in increasing cessation queries generally but is magnified when the population is primed by WNTD [33].

    This report builds on a programmatic agenda complementing tobacco control surveillance with digital data streams [34,35]. Epidemiologists have demonstrated the potential of digital surveillance for monitoring chickenpox [36,37], dengue [25,38], gastritis [36], influenza [18,39] including H1N1 [20], kidney stones [40,41], listeriosis [23], Lyme disease [42], methicillin-resistant Staphylococcus aureus [43], and salmonella outbreaks [22]. However, applications to health behaviors are very rare [20,27,34,35,44]. With smoking accounting for almost 6 million deaths each year [45], the application of digital surveillance to tobacco control may be of great significance. Herein we present our approach as a viable method to evaluate WNTD where traditional methods were ill equipped to do so.

    While the infoveillance approach has many strengths, it is not without limitations. We only considered increase in news coverage around WNTD and did not consider the placement of news coverage (eg, lead versus minor story), but this may be captured by news volume, where increased volume is associated with premium placement. Cessation interest was only assessed for smokers with access to the Internet, but we assume that changes in cessation interest among those with access mirrors those without access [46]. Recent studies encourage this assumption, suggesting queries are valid proxies for a host of health outcomes, even in disparate regions [25,39]. For example, depression queries correlate with suicide rates [47] and cancer queries correlate with cancer-specific incidence rates [48]. We compared WNTD with cigarette excise taxes in Mexico (the only nation with several cigarette excise tax increases), and all tax increases occurred on New Year’s Day; hence, WNTD’s approximation to a 2.8% tax increase might be larger in other nations and when taxes do not increase during New Year’s.

    Global health awareness campaigns are difficult to evaluate given sparse transnational data streams, and contemporary surveillance does not collect data on the same time dimensions as the campaigns that will likely effect change (eg, annual surveillance versus daily impacts) [12]. Tobacco control can learn much from adapting novel techniques that are gaining traction in biosurveillance [38]. Here we have built on validated approaches used in disease surveillance [25,38] and highlighted the potential advantages of these techniques over other tobacco control surveillance methods. Survey-based tobacco control surveillance has high financial costs, lacks timeliness, and may not reach some populations (eg, cell phone-only households) [49]. Also, responses gathered may be biased by strong social desirability [50]. Alternatives using passive data generation are only reliable in certain geographic areas and still require costly data processing (eg, nicotine replacement therapy sales) [51]. Digital surveillance, as such, is a critical forefront for tobacco control with real-time, public, and low-cost data streams useful for program and policy evaluations. Analyses of media and search query trends also afford greater transparency, as scientists may quickly replicate each other’s work, downloading data from regularly updated online archives. Extending our approach can serve as a continual evaluation system for global WNTD effects.

    In part, these results may outline how well WNTD’s yearly themes resonate with Latin American populations. In 2009 and 2010 when WNTD focused on tobacco health warnings and smoking among women, respectively, cessation news coverage was the highest. News coverage increases were smallest when WNTD focused on general campaigns, such as promoting the World Health Organization Framework Convention on Tobacco Control (2011) and promoting awareness of the health effects of nonsmoking-related tobacco harms (2006). The variability in cessation search queries was much smaller year to year, but increases were generally larger during WNTD’s clean indoor air (2007) and restricting youth access to tobacco (2008) campaigns.

    WNTD planners, and those responsible for tobacco cessation initiatives more broadly, may also use our results and techniques to scale up and refine the online components of their campaigns [52]. Since many search engines rank links according to the number of times searchers visit the page, or how many other pages link to a page, it is unrealistic to assume that creating cessation webpages, blogs, or YouTube videos will necessarily reach large numbers of tobacco users, even if they are seeking these resources. Search engine advertisements triggered by user-specific queries may be purchased for as little as US $0.01 per click. Advertised links appear on the first page of search results, ensuring that cessation queries meet webpages with current, health-conscious, and objective discussion of cessation when program planners advertise online. Search queries are a rare opportunity to reach smokers when they are thinking about cessation, while at the same time taking into account their stage in the cessation process with links individually tailored to optimize effectiveness [53,54]. By appropriately purchasing ad links, planners can ensure that evidence-based approaches maintain a strong first-page presence in cessation search results, especially around WNTD when many smokers appear interested in cessation. This is especially crucial given that most smokers attempt to quit without professional counseling or pharmacologic therapy [55].

    The effectiveness of WNTD has been widely speculated [8], but to our knowledge these are the first empirical estimates of its impact. In evaluating this intervention, we highlight the importance of digital surveillance for performing difficult evaluations using real-time, low-cost, and transparent methods. Herein we find that WNTD is producing large increases in cessation news coverage and cessation Internet search queries, rivaling the effects of Mexico’s recent tobacco tax increases and New Year’s resolutions. Because WNTD is constantly evolving, our work is also a framework for real-time surveillance and potential improvement in WNTD.

    Acknowledgments

    This research was supported by a grant to JWA from the Institute for Global Tobacco Control with funding from the Bloomberg Initiative to Reduce Tobacco Use. JWA was also supported by a grant from Google.org and a National Institute of Child Health & Human Development (NICHHD) Training Grant in Pediatric Emergency Medicine (5T32HD040128). A National Science Foundation (NSF) Graduate Research Fellowship also supported BMA. The Bloomberg Initiative to Reduce Tobacco Use, Google.org, NICHHD, and NSF had no role in the design and conduct of the study; in the collection, management, analysis, and interpretation of the data; or in the preparation, review, or approval of the manuscript. This report was improved by comments from a colloquium at Children’s Hospital Boston, University of North Carolina, and University of Southern California Keck School of Medicine. We thank John Brownstein, Elizabeth Kennedy, Ken Mandl, Seth Noar, Steve Sussman, and Jennifer Unger for their helpful criticisms.

    Authors' Contributions

    Study concept and design: JWA, JEC. Acquisition of data: JWA, BMA. Analysis and interpretation of data: JWA, BMA, JEC. Drafting of the manuscript: JWA, BMA, JPA. Critical revision of the manuscript for important intellectual content: JWA, BMA, JPA, DEF, KMR, JEC.

    Conflicts of Interest

    JWA and BMA share an equity stake in a consulting group, Directing Medicine, that helps others implement some of the ideas embodied in this work. The data generation procedures, however, are not proprietary and rely on public archives. There are no other conflicts of interest relevant to this study.

    Editorial note: This paper was originally peer-reviewed by another journal. JMIR reviewed the paper internally and accepted the peer-review reports and the authors' responses as forwarded by the author. Thus, the identity of the reviewers is not known to the editor.

    References

    1. Ezzati M, Lopez AD. Regional, disease specific patterns of smoking-attributable mortality in 2000. Tob Control 2004 Dec;13(4):388-395 [FREE Full text] [CrossRef] [Medline]
    2. Pampel F. National Income, Inequality and Global Patterns of Cigarette Use. Soc Forces 2007 Dec 1;86(2):445-466. [Medline]
    3. World Lung Foundation, American Cancer Society. The Tobacco Atlas   URL: http://www.tobaccoatlas.org/ [accessed 2012-05-17] [WebCite Cache]
    4. Centers for Disease Control and Prevention (CDC). Cigarette smoking among adults and trends in smoking cessation - United States, 2008. MMWR Morb Mortal Wkly Rep 2009 Nov 13;58(44):1227-1232 [FREE Full text] [Medline]
    5. World Health Organization. 2012 May 31. World No Tobacco Day   URL: http://www.who.int/mediacentre/events/annual/wntd/en/index.html [accessed 2012-05-17] [WebCite Cache]
    6. Müller F, Wehbe L. Smoking and smoking cessation in Latin America: a review of the current situation and available treatments. Int J Chron Obstruct Pulmon Dis 2008;3(2):285-293 [FREE Full text] [Medline]
    7. Franco-Marina F. Adult smoking trends in Mexico: an analysis of the Mexican National Addiction Surveys. Salud Publica Mex 2007;49(suppl 2):s137-s146. [CrossRef]
    8. Navas-Acien A, Peruga A, Breysse P, Zavaleta A, Blanco-Marquizo A, Pitarque R, et al. Secondhand tobacco smoke in public places in Latin America, 2002-2003. JAMA 2004 Jun 9;291(22):2741-2745. [CrossRef] [Medline]
    9. Sebrié EM, Blanco A, Glantz SA. Cigarette labeling policies in Latin America and the Caribbean: progress and obstacles. Salud Publica Mex 2010;52 Suppl 2:S233-S243 [FREE Full text] [Medline]
    10. Thrasher JF, Boado M, Sebrié EM, Bianco E. Smoke-free policies and the social acceptability of smoking in Uruguay and Mexico: findings from the International Tobacco Control Policy Evaluation Project. Nicotine Tob Res 2009 Jun;11(6):591-599. [CrossRef] [Medline]
    11. Thrasher JF, Pérez-Hernández R, Swayampakala K, Arillo-Santillán E, Bottai M. Policy support, norms, and secondhand smoke exposure before and after implementation of a comprehensive smoke-free law in Mexico city. Am J Public Health 2010 Sep;100(9):1789-1798. [CrossRef] [Medline]
    12. Castillo-Salgado C. Trends and directions of global public health surveillance. Epidemiol Rev 2010 Apr;32(1):93-109. [CrossRef] [Medline]
    13. Bala M, Strzeszynski L, Cahill K. Mass media interventions for smoking cessation in adults. Cochrane Database Syst Rev 2008(1):CD004704. [CrossRef] [Medline]
    14. Norman GJ, Ribisl KM, Howard-Pitney B, Howard KA, Unger JB. The relationship between home smoking bans and exposure to state tobacco control efforts and smoking behaviors. Am J Health Promot 2000;15(2):81-88. [Medline]
    15. Shadish WR, Cook TD. The renaissance of field experimentation in evaluating interventions. Annu Rev Psychol 2009;60:607-629. [CrossRef] [Medline]
    16. Popham WJ, Potter LD, Bal DG, Johnson MD, Duerr JM, Quinn V. Do anti-smoking media campaigns help smokers quit? Public Health Rep 1993;108(4):510-513. [Medline]
    17. Hahn EJ, Rayens MK, Butler KM, Zhang M, Durbin E, Steinke D. Smoke-free laws and adult smoking prevalence. Prev Med 2008 Aug;47(2):206-209. [CrossRef] [Medline]
    18. Eysenbach G. Infodemiology: tracking flu-related searches on the web for syndromic surveillance. AMIA Annu Symp Proc 2006:244-248. [Medline]
    19. Eysenbach G. Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet. J Med Internet Res 2009;11(1):e11 [FREE Full text] [CrossRef] [Medline]
    20. Eysenbach G. Infodemiology and infoveillance tracking online health information and cyberbehavior for public health. Am J Prev Med 2011 May;40(5 Suppl 2):S154-S158. [CrossRef] [Medline]
    21. Brownstein JS, Freifeld CC, Reis BY, Mandl KD. Surveillance Sans Frontières: Internet-based emerging infectious disease intelligence and the HealthMap project. PLoS Med 2008 Jul 8;5(7):e151 [FREE Full text] [CrossRef] [Medline]
    22. Brownstein JS, Freifeld CC, Madoff LC. Digital disease detection--harnessing the Web for public health surveillance. N Engl J Med 2009 May 21;360(21):2153-5, 2157 [FREE Full text] [CrossRef] [Medline]
    23. Wilson K, Brownstein JS. Early detection of disease outbreaks using the Internet. CMAJ 2009 Apr 14;180(8):829-831. [CrossRef] [Medline]
    24. Chunara R, Andrews JR, Brownstein JS. Social and news media enable estimation of epidemiological patterns early in the 2010 Haitian cholera outbreak. Am J Trop Med Hyg 2012 Jan;86(1):39-45. [CrossRef] [Medline]
    25. Althouse BM, Ng YY, Cummings DA. Prediction of dengue incidence using search query surveillance. PLoS Negl Trop Dis 2011 Aug;5(8):e1258 [FREE Full text] [CrossRef] [Medline]
    26. Keller M, Blench M, Tolentino H, Freifeld CC, Mandl KD, Mawudeku A, et al. Use of unstructured event-based reports for global infectious disease surveillance. Emerg Infect Dis 2009 May;15(5):689-695 [FREE Full text] [CrossRef] [Medline]
    27. Cobb NK. Online consumer search strategies for smoking-cessation information. Am J Prev Med 2010 Mar;38(3 Suppl):S429-S432. [CrossRef] [Medline]
    28. Dutka AF, Hanson HH. Fundamentals of Data Normalization. Reading, MA: Addison-Wesley; 1989.
    29. Kirchgassner G, Wolters J. Introduction to Modern Time Series Analysis. Berlin: Springer; 2007.
    30. King G, Tomz M, Wittenberg J. Making the most of statistical analyses: improving interpretation and presentation. Am J Pol Sci 2000;44:341-355.
    31. Conover WJ. Practical Nonparametric Statistics. New York, NY: Wiley; 1999.
    32. Jha P, Chaloupka FJ, Corrao M, Jacob B. Reducing the burden of smoking world-wide: effectiveness of interventions and their coverage. Drug Alcohol Rev 2006;25:597-609. [Medline]
    33. Scheufele DA, Tewksbury D. Framing, agenda setting, and priming: the evolution of three media effects models. Journal Commun 2007;57(1):9-20. [CrossRef]
    34. Ayers JW, Ribisl K, Brownstein JS. Using search query surveillance to monitor tax avoidance and smoking cessation following the United States' 2009 "SCHIP" cigarette tax increase. PLoS One 2011;6(3):e16777 [FREE Full text] [CrossRef] [Medline]
    35. Ayers JW, Ribisl KM, Brownstein JS. Tracking the rise in popularity of electronic nicotine delivery systems (electronic cigarettes) using search query surveillance. Am J Prev Med 2011 Apr;40(4):448-453. [CrossRef] [Medline]
    36. Pelat C, Turbelin C, Bar-Hen A, Flahault A, Valleron A. More diseases tracked by using Google Trends. Emerg Infect Dis 2009 Aug;15(8):1327-1328 [FREE Full text] [CrossRef] [Medline]
    37. Valdivia A, Monge-Corella S. Diseases tracked by using Google trends, Spain. Emerg Infect Dis 2010 Jan;16(1):168 [FREE Full text] [CrossRef] [Medline]
    38. Chan EH, Sahai V, Conrad C, Brownstein JS. Using web search query data to monitor dengue epidemics: a new model for neglected tropical disease surveillance. PLoS Negl Trop Dis 2011 May;5(5):e1206 [FREE Full text] [CrossRef] [Medline]
    39. Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, Brilliant L. Detecting influenza epidemics using search engine query data. Nature 2009 Feb 19;457(7232):1012-1014. [CrossRef] [Medline]
    40. Breyer BN, Sen S, Aaronson DS, Stoller ML, Erickson BA, Eisenberg ML. Use of Google Insights for Search to track seasonal and geographic kidney stone incidence in the United States. Urology 2011 Aug;78(2):267-271. [CrossRef] [Medline]
    41. Willard SD, Nguyen MM. Internet Search Trends Analysis Tools Can Provide Real-time Data on Kidney Stone Disease in the United States. Urology 2011 Jun 13 (forthcoming). [CrossRef] [Medline]
    42. Seifter A, Schwarzwalder A, Geis K, Aucott J. The utility of "Google Trends" for epidemiological research: Lyme disease as an example. Geospat Health 2010 May;4(2):135-137 [FREE Full text] [Medline]
    43. Dukic VM, David MZ, Lauderdale DS. Internet queries and methicillin-resistant Staphylococcus aureus surveillance. Emerg Infect Dis 2011 Jun;17(6):1068-1070 [FREE Full text] [CrossRef] [Medline]
    44. Reis BY, Brownstein JS. Measuring the impact of health policies using Internet search patterns: the case of abortion. BMC Public Health 2010;10:514 [FREE Full text] [CrossRef] [Medline]
    45. Ezzati M, Lopez AD. Estimates of global mortality attributable to smoking in 2000. Lancet 2003 Sep 13;362(9387):847-852. [CrossRef] [Medline]
    46. Stoddard JL, Augustson EM. Smokers who use internet and smokers who don't: data from the Health Information and National Trends Survey (HINTS). Nicotine Tob Res 2006 Dec;8 Suppl 1:S77-S85. [Medline]
    47. Yang AC, Tsai SJ, Huang NE, Peng CK. Association of Internet search trends with suicide death in Taipei City, Taiwan, 2004-2009. J Affect Disord 2011 Jul;132(1-2):179-184. [CrossRef] [Medline]
    48. Cooper CP, Mallon KP, Leadbetter S, Pollack LA, Peipins LA. Cancer Internet search activity on a major search engine, United States 2001-2003. J Med Internet Res 2005 Jul 1;7(3):e36 [FREE Full text] [CrossRef] [Medline]
    49. Boland M, Sweeney MR, Scallan E, Harrington M, Staines A. Emerging advantages and drawbacks of telephone surveying in public health research in Ireland and the U.K. BMC Public Health 2006;6:208 [FREE Full text] [CrossRef] [Medline]
    50. Ayers JW. Measuring English proficiency and language preference: are self-reports valid? Am J Public Health 2010 Aug;100(8):1364-6; author reply 1366. [CrossRef] [Medline]
    51. Metzger KB, Mostashari F, Kerker BD. Use of pharmacy data to evaluate smoking regulations' impact on sales of nicotine replacement therapies in New York City. Am J Public Health 2005 Jun;95(6):1050-1055. [CrossRef] [Medline]
    52. Bennett GG, Glasgow RE. The delivery of public health interventions via the Internet: actualizing their potential. Annu Rev Public Health 2009;30:273-292. [CrossRef] [Medline]
    53. Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull 2007 Jul;133(4):673-693. [CrossRef] [Medline]
    54. Herzog TA, Blagg CO. Are most precontemplators contemplating smoking cessation? Assessing the validity of the stages of change. Health Psychol 2007 Mar;26(2):222-231. [CrossRef] [Medline]
    55. Chapman S, MacKenzie R. The global research neglect of unassisted smoking cessation: causes and consequences. PLoS Med 2010 Feb;7(2):e1000216 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    CI: confidence interval
    RSV: relative search volume
    WNTD: World No Tobacco Day


    Edited by G Eysenbach; submitted 26.04.12; peer-reviewed by Anonymous, Anonymous, Anonymous; comments to author 14.05.12; revised version received 16.05.12; accepted 16.05.12; published 28.05.12

    ©John W Ayers, Benjamin M Althouse, Jon-Patrick Allem, Daniel E Ford, Kurt M Ribisl, Joanna E Cohen. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 28.05.2012.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.