This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.
Background
World No Tobacco Day (WNTD), commemorated annually on May 31, aims to inform the public about tobacco harms. Because tobacco control surveillance is usually annualized, the effectiveness of WNTD remains unexplored into its 25th year.
Objective
To explore the potential of digital surveillance (infoveillance) to evaluate the impacts of WNTD on population awareness of and interest in cessation.
Methods
Health-related news stories and Internet search queries were aggregated to form a continuous and real-time data stream. We monitored daily news coverage of and Internet search queries for cessation in seven Latin American nations from 2006 to 2011.
Results
Cessation news coverage peaked around WNTD, typically increasing 71% (95% confidence interval [CI] 61–81), ranging from 61% in Mexico to 83% in Venezuela. Queries indicative of cessation interest peaked on WNTD, increasing 40% (95% CI 32–48), ranging from 24% in Colombia to 84% in Venezuela. A doubling in cessation news coverage was associated with approximately a 50% increase in cessation queries. To gain a practical perspective, we compared WNTD-related activity with New Year’s Day and several cigarette excise tax increases in Mexico. Cessation queries around WNTD were typically greater than New Year’s Day and approximated a 2.8% (95% CI –0.8 to 6.3) increase in cigarette excise taxes.
Conclusions
This novel evaluation suggests WNTD had a significant impact on popular awareness (media trends) and individual interest (query trends) in smoking cessation. Because WNTD is constantly evolving, our work is also a model for real-time surveillance and potential improvement in WNTD and similar initiatives.
Tobacco is responsible for about 4 million premature deaths each year, mostly in developing countries [1] where smoking continues to find safe harbor [2]. Latin America has the seventh and third highest smoking-related mortality among men and women, respectively, in the 14 epidemiologic global regions [1]. Latin America’s share of smoking-attributable mortality will likely increase given the high prevalence of smoking: 43% of men and 23% of women smoke in Peru, 41% and 31% in Chile, 37% and 12% in Mexico, and 34% and 24% in Argentina, compared with 23% and 18% in the United States [3,4].
Mandated by the World Health Assembly in 1987 and commemorated annually on May 31, World No Tobacco Day (WNTD) aims to inform the public about the global tobacco epidemic using a combination of mass media approaches, including television, radio, and the Internet [5]. WNTD is believed to be especially important in regions with limited resources for cessation campaigns [6,7] and limited (albeit rapidly changing) tobacco control policy provisions, like in Latin America [8-11]. However, nearing the 25th anniversary of WTND, its effectiveness remains unexplored.
Because tobacco surveillance is typically annualized, it is exceedingly difficult to estimate the impact of a single awareness day [12]. In nearly all studies [13], investigators make comparisons using annual data from cross-sectional or cohort surveys before and after the intervention [14]; however, differences across the year may not be attributable to the intervention effect [15]. Sometimes investigators ask respondents in cross-sectional surveys to describe their exposure to an intervention, comparing those reporting exposure with those not reporting exposure [16]. Rarely, investigators use cross-sectional monthly survey responses to yield estimates on a finer temporal resolution [17], but these trends are costly to obtain and are still not useful for a single awareness day, given the primary effects are expected on a finer temporal resolution than months. Pioneering work in infodemiology and infoveillance provided a framework for how to assess WNTD’s potential effectiveness [18-23]. For instance, Twitter feeds presage cholera epidemics [24]; Internet search queries forecast dengue incidence [25]; and unstructured media reports provide the earliest alerts of disease outbreaks [26]. Building on this work, we employed a novel daily digital surveillance approach using freely available and public archives to estimate the effectiveness of WNTD in seven Latin American nations.
We monitored both intermediate and primary outcomes. First, WNTD may promote cessation awareness through the promotion of smoking cessation in news media [13]. By monitoring online news archives for articles promoting cessation, we captured cessation awareness trends that may have been motivated by WNTD. Second, WNTD may encourage smokers to search the Web for cessation resources [27]. By monitoring aggregate Internet search queries indicative of cessation, we captured interest in cessation that may have been motivated by WNTD. WNTD increases in cessation awareness may trigger increases in cessation interest; therefore, we examined the relationship between cessation news coverage and Internet search queries for cessation.
Methods
To address the study objectives, we analyzed online news media promoting cessation and online search queries for cessation from 2006 to 2011 in Mexico, Colombia, Argentina, Peru, Venezuela, Chile, and Ecuador using a quasi-experimental design [15].
We monitored weekly news stories archived on Google News that mentioned quitting smoking (Google Inc, Mountain View, CA, USA; news.google.com). Google News captures a broad spectrum of print, radio, and television media, and therefore is a useful archive to monitor cessation media stories. To identify the country of origin for each article, we downloaded data from nation-specific Google News domains (eg, news.google.com.mx for Mexico). All stories that mentioned smoking cessation were monitored relative to all stories in each nation. The numerator was the number of articles containing the phrase “dejar de fumar” (literally “give up smoking”), chosen based on discussion with experts and native Spanish speakers familiar with linguistic nuances across the nations monitored. The denominator was the number of stories that contained any universal conjunctive phrases, such as those containing “de,” thereby indicating a count of all stories. We report the resulting quotient per 100,000 stories.
Aggregate query trends were downloaded from Google Insights for Search (www.google.com/insights/). We monitored all queries that included “dejar de fumar” by nation. Trends were analyzed on a relative search volume (RSV) scale, with queries normalized to the period with the highest search proportion—for example, RSV = 100 is the highest search proportion period (cessation queries versus all search queries), and RSV = 50 is 50% of the highest search proportion. This approach corrects for trending in absolute search volume that is usually increasing for all common queries [28].
We analyzed data on weekly and daily time trends. Visual inspection of the data suggested the likely impact of WNTD was a pulse effect, an immediate change in mean news or query trends, rather than a durable shift. Because WNTD is a global program, there are no nations that may serve as untreated controls. As a result, we specified interrupted time series [29] within each nation to estimate the mean RSV around and including WNTD (3 weeks, including the week of, the week before, and the week after WNTD) to capture the rise and decline in WNTD spikes in reference to a within-nation RSV sampling from the 12 weeks before and after the WNTD period. The weeks before and after WNTD were included to capture presaging and lingering increases in news and search that was visually evident in the data inspection. We estimated the effect size as a ratio between WNTD and reference periods to make estimates comparable across nations (Ho:(RSVWNTD – RSVreference weeks)/RSVreference weeks = 0) [30]. To find the amount of variance in search queries explained by media trends, we regressed news trends lagged by 0, 1, and 2 weeks against search terms and reported r2 for all periods and after selecting only periods around WNTD [31].
Results
Figure 1 shows example cessation news coverage and cessation query trends in Mexico (patterns were similar in the six other study nations). Both news and query trends spiked in Mexico around WNTD. Averaging across years, cessation news trends typically peaked at 30 per 100,000 news stories the week of WNTD with cessation query trends peaking at 95% (RSV) of the highest search proportion week (with the highest RSV, 100, being on New Year’s Day 2008). Average trends across years (Figure 1B) suggested increases around WNTD were greater than the usual New Year’s spikes in Mexico. News and query peaks varied in their timing where there were strong buildups in news coverage beginning almost a month before WNTD, terminating 2 or 3 days after WNTD (Figure 1C), and queries had a pronounced peak around WNTD with queries remaining higher for a week after WNTD. Cessation news trends averaged 147 per 100,000 stories on WNTD, and queries had the highest search proportion day (RSV = 100) on WNTD.
Statistical analysis suggested WNTD was associated with increases in cessation news coverage and cessation queries in all nations (Figure 2). Averaging across all nations and years suggested cessation news trends were 71% (95% confidence interval [CI] 61–81) higher and cessation query trends were 40% (95% CI 32–48) higher around WNTD than expected, as compared with trends 12 weeks before and after the WNTD period. Cessation news increases varied year to year, ranging from 24% (95% CI 18–30) to 116% (95% CI 103–128) for 2006 and 2009, respectively. Cessation query increases ranged from 28% (95% CI 21–36) to 50% (95% CI 43–57) for 2009 and 2008, respectively. Analyses by nation suggested news mentions of cessation ranged from 61% (95% CI 31–91) to 83% (95% CI 53–113) higher around WNTD in Mexico and Venezuela, respectively (Figure 3). Cessation queries ranged from 24% (95% CI 15–32) to 84% (95% CI 68–100) higher around WNTD in Argentina and Venezuela, respectively.
Cessation news coverage explained limited amounts of variance in cessation queries. Multiple r2 ranged from .024 in Argentina to .516 in Mexico. Generally, cessation news coverage and cessation queries were not strongly associated across all time periods. However, the correlation between mean trends 3 months before to 3 months after WNTD was substantially higher (eg, r = .5 in Mexico). Figure 4 compares the magnitude of the effect sizes for search and news trend increases around WNTD by nation and year. Analyses showed increases in news trends (the week of, and before and after WNTD) were larger than increases in search query trends for nearly all the years, suggesting increases in cessation news coverage had diminishing returns on cessation queries during this narrow period. As such, a doubling in cessation news coverage corresponded with about a 50% increase in cessation queries.
Increases in cessation news coverage and cessation queries around WNTD need to be placed in practical perspective. Cigarette excise tax increases are the most effective tobacco control policy [32]. Around New Year’s Day in 2007, 2008, 2009, and 2011, Mexico increased its cigarette excise tax 4.7%, 1.3%, 1.2%, and 7.8%, respectively. We compared increases in cessation news coverage and cessation queries around WNTD with those from these tax years. In Mexico, increases in cessation queries around New Year’s Day (compared with the WNTD baseline) were as little as 10% (95% CI 2–23). WNTD-related increases were typically much larger than New Year’s-related increases in absence of a tax increase and were sometimes greater than increases when a new tax increase was also implemented. Regressing tax increases against WNTD increases across years and predicting the result for the overall mean suggested that WNTD increases in cessation news coverage and query trends approximated those for a 2.8% (95% CI –0.8 to 6.3) cigarette excise tax increase. Additionally, the estimate is based on a small sample (6 years), so while it is qualitatively accurate, the effect of WNTD may be equivalent to a somewhat lower or higher tax, especially since all tax increases occurred in addition to any New Year’s effects.
Example World No Tobacco Day (WNTD) time trends in Mexico, 2006-2011.
(A) Entire series by week, (B) entire weekly series with mean annualized estimate, and (C) daily series with mean estimates. Daily query estimates were restricted to 2010 and 2011 due to data unavailability.
Pooled estimates of World No Tobacco Day effectiveness in Latin America, 2006-2011.
Estimates are made comparing the week of (and before and after) World No Tobacco Day with 12 weeks before and after that period.
Nation-specific estimates of World No Tobacco Day effectiveness in Latin America, 2006-2011.
Dotted line indicates average effect for all nations and years as a reference point. Data were unavailable in Ecuador, Chile, and Columbia for 2006 and 2007.
Cessation news coverage is positively associated with cessation Internet search queries.
Nodes are sized according to mean annual search query volume, with nodes by nation and year.
Discussion
We demonstrated the feasibility of novel digital surveillance for tobacco control, yielding the first population estimates of WNTD’s effectiveness in the first program evaluation to use digital surveillance. WNTD coincided with large increases in cessation news coverage and cessation Internet search queries in seven Latin American nations. WNTD increases eclipsed New Year’s Day increases and approximated the effectiveness of the combination of New Year’s and a 2.8% cigarette tax hike. There was little correlation between news trends and query trends when comparing across the entire time series, but higher correlation when comparing trends around WNTD. This may indicate that news plays a minor role in increasing cessation queries generally but is magnified when the population is primed by WNTD [33].
This report builds on a programmatic agenda complementing tobacco control surveillance with digital data streams [34,35]. Epidemiologists have demonstrated the potential of digital surveillance for monitoring chickenpox [36,37], dengue [25,38], gastritis [36], influenza [18,39] including H1N1 [20], kidney stones [40,41], listeriosis [23], Lyme disease [42], methicillin-resistant Staphylococcus aureus [43], and salmonella outbreaks [22]. However, applications to health behaviors are very rare [20,27,34,35,44]. With smoking accounting for almost 6 million deaths each year [45], the application of digital surveillance to tobacco control may be of great significance. Herein we present our approach as a viable method to evaluate WNTD where traditional methods were ill equipped to do so.
While the infoveillance approach has many strengths, it is not without limitations. We only considered increase in news coverage around WNTD and did not consider the placement of news coverage (eg, lead versus minor story), but this may be captured by news volume, where increased volume is associated with premium placement. Cessation interest was only assessed for smokers with access to the Internet, but we assume that changes in cessation interest among those with access mirrors those without access [46]. Recent studies encourage this assumption, suggesting queries are valid proxies for a host of health outcomes, even in disparate regions [25,39]. For example, depression queries correlate with suicide rates [47] and cancer queries correlate with cancer-specific incidence rates [48]. We compared WNTD with cigarette excise taxes in Mexico (the only nation with several cigarette excise tax increases), and all tax increases occurred on New Year’s Day; hence, WNTD’s approximation to a 2.8% tax increase might be larger in other nations and when taxes do not increase during New Year’s.
Global health awareness campaigns are difficult to evaluate given sparse transnational data streams, and contemporary surveillance does not collect data on the same time dimensions as the campaigns that will likely effect change (eg, annual surveillance versus daily impacts) [12]. Tobacco control can learn much from adapting novel techniques that are gaining traction in biosurveillance [38]. Here we have built on validated approaches used in disease surveillance [25,38] and highlighted the potential advantages of these techniques over other tobacco control surveillance methods. Survey-based tobacco control surveillance has high financial costs, lacks timeliness, and may not reach some populations (eg, cell phone-only households) [49]. Also, responses gathered may be biased by strong social desirability [50]. Alternatives using passive data generation are only reliable in certain geographic areas and still require costly data processing (eg, nicotine replacement therapy sales) [51]. Digital surveillance, as such, is a critical forefront for tobacco control with real-time, public, and low-cost data streams useful for program and policy evaluations. Analyses of media and search query trends also afford greater transparency, as scientists may quickly replicate each other’s work, downloading data from regularly updated online archives. Extending our approach can serve as a continual evaluation system for global WNTD effects.
In part, these results may outline how well WNTD’s yearly themes resonate with Latin American populations. In 2009 and 2010 when WNTD focused on tobacco health warnings and smoking among women, respectively, cessation news coverage was the highest. News coverage increases were smallest when WNTD focused on general campaigns, such as promoting the World Health Organization Framework Convention on Tobacco Control (2011) and promoting awareness of the health effects of nonsmoking-related tobacco harms (2006). The variability in cessation search queries was much smaller year to year, but increases were generally larger during WNTD’s clean indoor air (2007) and restricting youth access to tobacco (2008) campaigns.
WNTD planners, and those responsible for tobacco cessation initiatives more broadly, may also use our results and techniques to scale up and refine the online components of their campaigns [52]. Since many search engines rank links according to the number of times searchers visit the page, or how many other pages link to a page, it is unrealistic to assume that creating cessation webpages, blogs, or YouTube videos will necessarily reach large numbers of tobacco users, even if they are seeking these resources. Search engine advertisements triggered by user-specific queries may be purchased for as little as US $0.01 per click. Advertised links appear on the first page of search results, ensuring that cessation queries meet webpages with current, health-conscious, and objective discussion of cessation when program planners advertise online. Search queries are a rare opportunity to reach smokers when they are thinking about cessation, while at the same time taking into account their stage in the cessation process with links individually tailored to optimize effectiveness [53,54]. By appropriately purchasing ad links, planners can ensure that evidence-based approaches maintain a strong first-page presence in cessation search results, especially around WNTD when many smokers appear interested in cessation. This is especially crucial given that most smokers attempt to quit without professional counseling or pharmacologic therapy [55].
The effectiveness of WNTD has been widely speculated [8], but to our knowledge these are the first empirical estimates of its impact. In evaluating this intervention, we highlight the importance of digital surveillance for performing difficult evaluations using real-time, low-cost, and transparent methods. Herein we find that WNTD is producing large increases in cessation news coverage and cessation Internet search queries, rivaling the effects of Mexico’s recent tobacco tax increases and New Year’s resolutions. Because WNTD is constantly evolving, our work is also a framework for real-time surveillance and potential improvement in WNTD.
AbbreviationsCI
confidence interval
RSV
relative search volume
WNTD
World No Tobacco Day
This research was supported by a grant to JWA from the Institute for Global Tobacco Control with funding from the Bloomberg Initiative to Reduce Tobacco Use. JWA was also supported by a grant from Google.org and a National Institute of Child Health & Human Development (NICHHD) Training Grant in Pediatric Emergency Medicine (5T32HD040128). A National Science Foundation (NSF) Graduate Research Fellowship also supported BMA. The Bloomberg Initiative to Reduce Tobacco Use, Google.org, NICHHD, and NSF had no role in the design and conduct of the study; in the collection, management, analysis, and interpretation of the data; or in the preparation, review, or approval of the manuscript. This report was improved by comments from a colloquium at Children’s Hospital Boston, University of North Carolina, and University of Southern California Keck School of Medicine. We thank John Brownstein, Elizabeth Kennedy, Ken Mandl, Seth Noar, Steve Sussman, and Jennifer Unger for their helpful criticisms.
Study concept and design: JWA, JEC. Acquisition of data: JWA, BMA. Analysis and interpretation of data: JWA, BMA, JEC. Drafting of the manuscript: JWA, BMA, JPA. Critical revision of the manuscript for important intellectual content: JWA, BMA, JPA, DEF, KMR, JEC.
JWA and BMA share an equity stake in a consulting group, Directing Medicine, that helps others implement some of the ideas embodied in this work. The data generation procedures, however, are not proprietary and rely on public archives. There are no other conflicts of interest relevant to this study.
Editorial note: This paper was originally peer-reviewed by another journal. JMIR reviewed the paper internally and accepted the peer-review reports and the authors' responses as forwarded by the author. Thus, the identity of the reviewers is not known to the editor.
EzzatiMLopezADRegional, disease specific patterns of smoking-attributable mortality in 20002004121343889510.1136/tc.2003.0052151556462313/4/388PMC1747946PampelFNational Income, Inequality and Global Patterns of Cigarette Use200712186244546621874072PMC31614042012-05-17The Tobacco Atlashttp://www.tobaccoatlas.org/67k0IySdbCenters for Disease Control and Prevention (CDC)Cigarette smoking among adults and trends in smoking cessation - United States, 200820091113584412273219910909mm5844a2201205312012-05-17World No Tobacco Dayhttp://www.who.int/mediacentre/events/annual/wntd/en/index.html67k0KX2PxMüllerFWehbeLSmoking and smoking cessation in Latin America: a review of the current situation and available treatments2008322859318686737PMC2629971Franco-MarinaFAdult smoking trends in Mexico: an analysis of the Mexican National Addiction Surveys200749suppl 2s1374610.1590/S0036-36342007000800004Navas-AcienAPerugaABreyssePZavaletaABlanco-MarquizoAPitarqueRAcuñaMJiménez-ReyesKColomboVLGamarraGStillmanFASametJSecondhand tobacco smoke in public places in Latin America, 2002-20032004069291222741510.1001/jama.291.22.274115187056291/22/2741SebriéEMBlancoAGlantzSACigarette labeling policies in Latin America and the Caribbean: progress and obstacles201052 Suppl 2S2334321243194S0036-36342010000800019PMC3090221ThrasherJFBoadoMSebriéEMBiancoESmoke-free policies and the social acceptability of smoking in Uruguay and Mexico: findings from the International Tobacco Control Policy Evaluation Project200906116591910.1093/ntr/ntp03919380383ntp039PMC2688601ThrasherJFPérez-HernándezRSwayampakalaKArillo-SantillánEBottaiMPolicy support, norms, and secondhand smoke exposure before and after implementation of a comprehensive smoke-free law in Mexico city201009100917899810.2105/AJPH.2009.18095020466952AJPH.2009.180950Castillo-SalgadoCTrends and directions of global public health surveillance2010043219310910.1093/epirev/mxq00820534776mxq008BalaMStrzeszynskiLCahillKMass media interventions for smoking cessation in adults20081CD00470410.1002/14651858.CD004704.pub218254058NormanGJRibislKMHoward-PitneyBHowardKAUngerJBThe relationship between home smoking bans and exposure to state tobacco control efforts and smoking behaviors200015281811194699ShadishWRCookTDThe renaissance of field experimentation in evaluating interventions2009606072910.1146/annurev.psych.60.110707.16354418616391PophamWJPotterLDBalDGJohnsonMDDuerrJMQuinnVDo anti-smoking media campaigns help smokers quit?1993108451038341788PMC1403416HahnEJRayensMKButlerKMZhangMDurbinESteinkeDSmoke-free laws and adult smoking prevalence200808472206910.1016/j.ypmed.2008.04.00918519154S0091-7435(08)00209-0EysenbachGInfodemiology: tracking flu-related searches on the web for syndromic surveillance200624481723834086095PMC1839505EysenbachGInfodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet2009111e1110.2196/jmir.115719329408v11i1e11PMC2762766EysenbachGInfodemiology and infoveillance tracking online health information and cyberbehavior for public health201105405 Suppl 2S154810.1016/j.amepre.2011.02.00621521589S0749-3797(11)00088-2BrownsteinJSFreifeldCCReisBYMandlKDSurveillance Sans Frontières: Internet-based emerging infectious disease intelligence and the HealthMap project200807857e15110.1371/journal.pmed.00501511861374707-PLME-HIA-1838PMC2443186BrownsteinJSFreifeldCCMadoffLCDigital disease detection--harnessing the Web for public health surveillance200905213602121535, 215710.1056/NEJMp090070219423867NEJMp0900702PMC2917042WilsonKBrownsteinJSEarly detection of disease outbreaks using the Internet2009041418088293110.1503/cmaj.09021519364791180/8/829PMC2665960ChunaraRAndrewsJRBrownsteinJSSocial and news media enable estimation of epidemiological patterns early in the 2010 Haitian cholera outbreak201201861394510.4269/ajtmh.2012.11-05972223244986/1/39PMC3247107AlthouseBMNgYYCummingsDAPrediction of dengue incidence using search query surveillance20110858e125810.1371/journal.pntd.000125821829744PNTD-D-11-00369PMC3149016KellerMBlenchMTolentinoHFreifeldCCMandlKDMawudekuAEysenbachGBrownsteinJSUse of unstructured event-based reports for global infectious disease surveillance2009051556899510.3201/eid1505.08111419402953PMC2687026CobbNKOnline consumer search strategies for smoking-cessation information201003383 SupplS4293210.1016/j.amepre.2009.12.00120176318S0749-3797(09)00865-4DutkaAFHansonHH1989Reading, MAAddison-WesleyKirchgassnerGWoltersJ2007BerlinSpringerKingGTomzMWittenbergJMaking the most of statistical analyses: improving interpretation and presentation20004434155ConoverWJ1999New York, NYWileyJhaPChaloupkaFJCorraoMJacobBReducing the burden of smoking world-wide: effectiveness of interventions and their coverage20062559760917132576ScheufeleDATewksburyDFraming, agenda setting, and priming: the evolution of three media effects models200757192010.1111/j.0021-9916.2007.00326.xAyersJWRibislKBrownsteinJSUsing search query surveillance to monitor tax avoidance and smoking cessation following the United States' 2009 "SCHIP" cigarette tax increase201163e1677710.1371/journal.pone.001677721436883PMC3059206AyersJWRibislKMBrownsteinJSTracking the rise in popularity of electronic nicotine delivery systems (electronic cigarettes) using search query surveillance2011044044485310.1016/j.amepre.2010.12.00721406279S0749-3797(10)00793-2PelatCTurbelinCBar-HenAFlahaultAValleronAMore diseases tracked by using Google Trends2009081581327810.3201/eid1508.09029919751610PMC2815981ValdiviaAMonge-CorellaSDiseases tracked by using Google trends, Spain20100116116810.3201/eid1601.09130820031078PMC2874385ChanEHSahaiVConradCBrownsteinJSUsing web search query data to monitor dengue epidemics: a new model for neglected tropical disease surveillance20110555e120610.1371/journal.pntd.000120621647308PNTD-D-11-00327PMC3104029GinsbergJMohebbiMHPatelRSBrammerLSmolinskiMSBrilliantLDetecting influenza epidemics using search engine query data2009021945772321012410.1038/nature0763419020500nature07634BreyerBNSenSAaronsonDSStollerMLEricksonBAEisenbergMLUse of Google Insights for Search to track seasonal and geographic kidney stone incidence in the United States2011087822677110.1016/j.urology.2011.01.01021459414S0090-4295(11)00028-8WillardSDNguyenMMInternet Search Trends Analysis Tools Can Provide Real-time Data on Kidney Stone Disease in the United States20110613(forthcoming)10.1016/j.urology.2011.04.02421676450S0090-4295(11)00418-3SeifterASchwarzwalderAGeisKAucottJThe utility of "Google Trends" for epidemiological research: Lyme disease as an example20100542135720503183DukicVMDavidMZLauderdaleDSInternet queries and methicillin-resistant Staphylococcus aureus surveillance20110617610687010.3201/eid/1706.10145121749772ReisBYBrownsteinJSMeasuring the impact of health policies using Internet search patterns: the case of abortion20101051410.1186/1471-2458-10-514207388501471-2458-10-514PMC2936430EzzatiMLopezADEstimates of global mortality attributable to smoking in 20002003091336293878475210.1016/S0140-6736(03)14338-313678970S0140-6736(03)14338-3StoddardJLAugustsonEMSmokers who use internet and smokers who don't: data from the Health Information and National Trends Survey (HINTS)2006128 Suppl 1S778517491174YangACTsaiSJHuangNEPengCKAssociation of Internet search trends with suicide death in Taipei City, Taiwan, 2004-20092011071321-21798410.1016/j.jad.2011.01.01921371755S0165-0327(11)00052-8CooperCPMallonKPLeadbetterSPollackLAPeipinsLACancer Internet search activity on a major search engine, United States 2001-2003200507173e3610.2196/jmir.7.3.e3615998627v7i3e36PMC1550657BolandMSweeneyMRScallanEHarringtonMStainesAEmerging advantages and drawbacks of telephone surveying in public health research in Ireland and the U.K2006620810.1186/1471-2458-6-208169117711471-2458-6-208PMC1560130AyersJWMeasuring English proficiency and language preference: are self-reports valid?201008100813646; author reply 136610.2105/AJPH.2010.19416720558784AJPH.2010.194167MetzgerKBMostashariFKerkerBDUse of pharmacy data to evaluate smoking regulations' impact on sales of nicotine replacement therapies in New York City2005069561050510.2105/AJPH.2004.0480251591483295/6/1050PMC1449307BennettGGGlasgowREThe delivery of public health interventions via the Internet: actualizing their potential2009302739210.1146/annurev.publhealth.031308.10023519296777NoarSMBenacCNHarrisMSDoes tailoring matter? Meta-analytic review of tailored print health behavior change interventions20070713346739310.1037/0033-2909.133.4.673175929612007-09203-006HerzogTABlaggCOAre most precontemplators contemplating smoking cessation? Assessing the validity of the stages of change2007032622223110.1037/0278-6133.26.2.222173859742007-03487-012ChapmanSMacKenzieRThe global research neglect of unassisted smoking cessation: causes and consequences20100272e100021610.1371/journal.pmed.100021620161722PMC2817714