Published on 23.02.12 in Vol 14, No 1 (2012): Jan-Feb
Broad Reach and Targeted Recruitment Using Facebook for an Online Survey of Young Adult Substance Use
Background: Studies of tobacco use and other health behaviors have reported great challenges in recruiting young adults. Social media is widely used by young adults in the United States and represents a potentially fast, affordable method of recruiting study participants for survey research.
Objective: The present study examined Facebook as a mechanism to reach and survey young adults about tobacco and other substance use.
Methods: Participants were cigarette users, age 18-25 years old, living throughout the United States and recruited through Facebook to complete a survey about tobacco and other substance use. Paid advertising using Facebook’s Ad program over 13 months from 2010 Feb 28 to 2011 Apr 4 targeted by age (18-25), location (United States or California), language (English), and tobacco- and/or marijuana-related keywords. Facebook approved all ads.
Results: The campaign used 20 ads, which generated 28,683,151 impressions, yielding 14,808 clicks (0.7% of targeted Facebook members), at an overall cost of $6,628.24. The average cost per click on an ad was $0.45. The success of individual ads varied widely. There was a rise in both clicks and impressions as the campaign grew. However, the peak for clicks was 3 months before the peak for ad impressions. Of the 69,937,080 accounts for those age 18-25 in the United States, Facebook estimated that 2.8% (n = 1,980,240) were reached through tobacco and marijuana keywords. Our campaign yielded 5237 signed consents (35.4% of clicks), of which 3093 (59%) met criteria, and 1548 (50% of those who met criteria) completed the survey. The final cost per valid completed survey was $4.28. The majority of completed surveys came from whites (69%) and males (72%). The sample averaged 8.9 cigarettes per day (SD 7.5), 3.8 years of smoking (SD 2.9), with a median of 1 lifetime quit attempts; 48% did not intend to quit smoking in the next 6 months.
Conclusions: Despite wide variety in the success of individual ads and potential concerns about sample representativeness, Facebook was a useful, cost-effective recruitment source for young-adult smokers to complete a survey about the use of tobacco and other substances. The current findings support Facebook as a viable recruitment option for assessment of health behavior in young adults.
J Med Internet Res 2012;14(1):e28
Studies of tobacco use and other health behaviors have reported great challenges in recruiting young adults [, ]. The Internet, increasingly used as a method to target and survey individuals about health-risk behaviors, may be a useful tool for reaching young adults. Compared to face-to-face interviews, Internet-based surveys can reach more potential respondents; enable inclusion of low-incidence or “hidden” population groups; enable rapid, convenient input by respondents; and reduce bias in response to sensitive, potentially stigmatizing topics [ - ]. A recent telephone survey of young adults age 18-29 in the United States indicates that almost all (93%) use the Internet [ ]. Further, over the past decade, young adults have remained the age group most likely to go online.
Studies of Internet-based tobacco-cessation treatment have demonstrated high enrollment among general-aged adult participants through advertisements on Google or other search engines . An intervention for smokeless tobacco (Chewfree.com) used advertisements on Google.com and generated 9155 clicks and 511 intervention participants at a cost of $6.70 per participant; advertisements on other search engines generated 363 participants (mean age, 34.5 years) in 15 months [ ]. In another online smoking-cessation intervention (Quitnet [ ]) advertisements on Google resulted in 28,296 clicks, producing 5557 eligible participants. Of these, 1489 gave informed consent and 764 (mean age 35.1 years) completed a baseline assessment in 6 weeks. In our previous work using the Internet to recruit young-adult smokers in survey research, advertisements across the Web yielded the largest proportion of recruited participants and completed surveys overall; however, Craigslist and an online sampling company were more successful at targeting young-adult smokers who went on to complete the survey and ultimately were the more cost-effective methods compared to Internet advertisements [ ].
Social media is widely used by young adults in the United States. Nearly three quarters (72%) of online 18-29-year-olds use social-networking websites, with 45% doing so on a typical day . Facebook, the largest social-networking website and second most popular website in the United States after Google [ ], has more than 500 million users worldwide, half of whom use the site daily [ ]. Facebook represents a potentially fast and affordable method of recruiting study participants for survey research, especially young adults who use the site in large numbers and on a frequent basis. Given the increasing interest in using social media for recruiting participants to research, the current study reports on the success of an ad campaign on Facebook, the leader in this space. We believe this is the first study to examine Facebook as a mechanism to reach and survey young adults about health behavior.
The target population was young-adult cigarette users, age 18-25 years, living throughout the United States. Individuals had to be English literate and smoke at least one cigarette in the past 30 days to be eligible for participation.
Facebook Recruitment Campaign
To reach young adults who had smoked recently, we paid for advertising using Facebook’s Advertising (Ad) program over 13 months from 2010 Feb 28 to 2011 Apr 4. Our campaign involved creating advertisements that appeared on the pages of our target audience meeting the criteria of age (18-25), location (United States or California), language (English), and tobacco- and/or marijuana-related keywords that appeared in their Facebook profiles through listed interests, activities, education and job titles, pages they like, or groups to which they belong (eg, “cigarette,” “nicotine,” “blunt,” “420”). At the time of this campaign, this was the only way Facebook ad could be targeted (ie, there was no way to target keywords to other areas of the Facebook profile). Facebook had to approve all ads based on the company’s guidelines . Only one ad type was available to advertisers at the time the campaign was launched. Ads included a short (eg, 2-word) headline, a picture, and a link to the study’s survey website per Facebook’s advertising size and word-count specifications. Facebook rejected an ad that targeted both tobacco and marijuana users through pictures. Therefore that ad made no impressions. We incurred a charge every time a user clicked on one of our ads.
On a daily basis, we could specify a spending limit for each ad and for the entire campaign. We, like other advertisers, could then specify the maximum amount we would be willing to pay for an ad (a “bid”). Then auctions determined the likelihood a given ad would be shown on pages of the target audience. Selection criteria included bid (the amount an advertiser is willing to pay), quality of an ad (including feedback an ad has received from users), and past performance . For a given ad, Facebook suggests a “bid range” based on how much other advertisers would be willing to pay to reach the same target audience. This range can change over time based on both the ad space (other ads in the pool of ads) or an ad’s performance. Our bids fluctuated over time in line with the bid range for a given ad. Facebook reports statistics on bids, impressions, clicks, and dollars spent on all ads in a campaign. Impressions are defined as a single time an ad is shown to a user, regardless of whether the user clicks on the ad. Clicks are when a user clicks a link in an ad. We used the Facebook-provided statistics indicating the success of each advertisement we ran and changed or stopped ads that were unsuccessful (ie, they rarely appeared, they received too few clicks, or they were too expensive). As such, we explored various picture and text options and determined the most successful ads based on impressions, clicks, and costs. Facebook, which normally restricts the reporting of its data, gave us permission, conveyed to our university’s legal counsel, to publish these statistics.
The Institutional Review Board approved study procedures, described in detail previously. Participants provided informed consent [, ]. The online survey included basic demographics and a series of measures of smoking and other substance-use behaviors and thoughts about use. A Smoking Questionnaire assessed participants’ years of smoking, prior quit attempts (lifetime and past year), and longest period of abstinence in a prior quit attempt [ ]. The Smoking Stages of Change Questionnaire [ ] assessed motivation to quit, categorizing smokers into 1 of 3 preaction stages of change: precontemplation: no intention to quit within the next 6 months; contemplation: intention to quit within the next 6 months but no 24-hour quit attempt in the past year; preparation: intention to quit within the next month and a 24-hour quit attempt in the past year. The Thoughts about Abstinence form [ ] assessed desire to quit, anticipated success with quitting, and perceived difficulty with abstinence (each rated on a scale of 1 to 10). Participants were required to answer all questions before they could continue to the next page of the survey and could quit the survey at any time. Computer Internet Protocol (IP) addresses were tracked and multiple entries were not accepted from the same computer. Data were deemed invalid and excluded from analyses if (1) there was a discrepancy in data from duplicate questions (eg, date of birth; n = 215), (2) respondents reported the same contact email address across multiple survey entries (n = 50), or (3) the data were clearly invalid (eg, every entry was the same across the entire survey; n = 28). At the end of the recruitment period, each completed survey entry associated with a valid email address was entered into a drawing to win a $400 gift certificate to Apple stores or a $25 gift certificate to a national or online store.
During the 13-month campaign, our ads made 28,683,151 impressions, yielding 14,808 clicks, at an overall cost of $6,628.24. The average cost per click on an ad was $0.45. Twenty different ads were run. Of those, 14 were targeted throughout the United States and 6 specifically to California; 7 asked participants if they “ever smoke,” 7 asked if they “ever smoked cigarettes,” and 6 asked if they “smoked recently;” 8 had a cartoon picture, including lit cigarettes (n = 3) and a cigarette pack (n = 5); and 12 had a realistic picture, including a lit cigarette (n = 3), a cigarette pack (n = 3), multiple cigarettes (n = 3), and a person smoking a cigarette (n = 3).
The success of individual ads varied widely.illustrates, as an example, 2 sets of 3 ads deemed highly successful, moderately successful, or unsuccessful based on their campaign statistics. The most successful ad in our campaign had over 8 million impressions, which yielded over 5000 clicks, and cost $0.38 per click ( a). Other ads varied in the number of clicks and costs per click (eg, b). Some ads made impressions but were not clicked on at all. For these we did not incur any charges ( c).
presents the rate of impressions and clicks compared to campaign costs for the entire campaign over 13 months. There was a rise in both clicks and impressions as the campaign grew. However, the peak for clicks was in the summer of 2010, which was 3 months before the peak for ad impressions (October 2010). There was a large drop-off in impressions between October 2010 and January 2011, without a corresponding shift in clicks or costs, highlighting that the clicks were coming from a few consistently successful ads throughout that period.
summarizes the numbers of potential Facebook accounts reached through various target characteristics, the clicks our ads received, and the sample who reached and completed our survey. Of the 69,937,080 Facebook accounts registered to individuals age 18-25 in the United States, 2.8% (n = 1,980,240) had profiles with tobacco- and marijuana-related keywords (our target population). Our campaign received 14,808 clicks (0.7% of potential accounts reached through the campaign), which yielded 5237 signed consents, of which 3093 (n = 59%) met study-inclusion criteria, and 1548 (50% of those who met criteria) completed the survey. The final cost per valid, completed survey was $4.28.
presents sociodemographic and tobacco-use characteristics of the sample that completed the survey. The majority of participants were male and white. All four US census regions were represented, with the Northeast having the lowest representation (20.2%). The sample averaged 8.9 cigarettes per day (SD 7.5) and 3.8 years of smoking (SD 2.9). Sixty-three percent reported a lifetime quit attempt of at least 24-hours’ duration. At the time of survey completion, 48% were not intending to quit smoking in the next 6 months (ie, precontemplation stage of change); 30% were contemplating quitting in the next 6 months, but not in the next 30 days (ie, contemplation); and 23% were preparing to quit in the next 30 days and reported a quit attempt in the past year (ie, preparation).
Overall, Facebook was a successful recruitment source for young-adult smokers to complete a survey about tobacco and other substance use. At $4.28 per completed survey, this method proved much more affordable than other methods we used in previous survey research with this population, especially given the minimal staff time to design and monitor the campaign. In our prior work, the cost per completed survey was $42.77 for an Internet marketing company to place ads throughout the web and $19.24 for a survey sampling company to email survey announcements to young adults . Traditional recruitment mechanisms, such as newspaper or radio advertising or hired survey sampling companies, tend to be far more expensive and take more time for participant screening. Other Internet-based recruitment mechanisms that have proven successful at recruiting for smoking-cessation interventions, such as Google’s AdWords program [ , ], are not as easy to use for targeting a specific demographic population. As a result, such mechanisms require users to screen participants more thoroughly and to validate data generated through these recruitment methods.
Facebook is a useful mechanism for recruiting young research participants in a field that has shown past challenges. Nearly half (48%) of those completing the survey were unmotivated to quit smoking within the next 6 months. Smokers unmotivated to quit may be particularly challenging to recruit into face-to-face research studies, further highlighting the value of online methods. The current findings indicate that Facebook, compared to other mechanisms, may be particularly effective at recruiting smokers unmotivated to quit in the near future as the proportion was higher than that in our prior research of online recruitment of young-adult smokers . Young adults are conducting daily communications at an increasing rate via mobile methods, rather than by face-to-face encounters or by telephone at home, making traditional methods of recruitment and assessment increasingly obsolete [ ]. Researchers desiring to understand health behavior of young adults (especially stigmatized behavior) should consider social media as a viable option for recruitment.
The campaign’s success was predicated upon Facebook’s approval of each advertisement. The advertising policy strictly forbids the sale of or reference to tobacco products as well as mention of illegal activity . To obtain Facebook approval of our tobacco ads, we provided evidence that we represented an academic research study. However, an ad with a picture of a marijuana leaf on it was not approved. Facebook’s wide reach makes it a useful way to target hard-to-reach populations; however, to adhere to Facebook’s guidelines, studies dealing with illegal activity, such as underage alcohol use or illicit drug use, may be required to use more neutral words and pictures, and thus may reach a wider population than their intended subject pool.
A limitation to recruitment through Facebook is that the representativeness of the sample cannot be fully determined. At the time of recruitment, Facebook reported the number of total Facebook accounts potentially targeted by any given set of demographic characteristics or keywords; however, there was no ability to compare this larger population to the eventual sample generated through an ad campaign. At the time the campaign was implemented, there was also no way to determine how many individuals within the population were exposed to at least one advertisement. It is possible that Facebook will choose to make this information available but it is at their discretion. The data that Facebook did provide for each ad (eg, impressions, clicks, costs) made it simple to continuously evaluate and optimize our campaign.
The research presented here used a cross-sectional survey design. There is limited knowledge about Facebook’s success at reaching and retaining young adults in longitudinal treatment-outcome studies or clinical trials. Given the high proportion of recruited smokers unmotivated to quit, tobacco-treatment models that do not require immediate cessation (eg, stage-tailored interventions, smoking reduction) may be particularly appropriate, although this should be confirmed. As a common method of communication for young people all over the world, social media represents a useful strategy that can be leveraged for research to find and engage potentially hard-to-reach populations.
This study was supported by an individual postdoctoral fellowship award from the California Tobacco-Related Diseases Research Program (18FT-0055; Danielle E. Ramo, principal investigator), and an institutional training grant (T32 DA007250; James L. Sorensen, principal investigator) and center grant from the National Institute on Drug Abuse (P50 DA09253; Joseph Guydish, principal investigator). The preparation of this manuscript was supported in part by a career development award from National Institute on Drug Abuse (K23 DA018691; Judith J. Prochaska, principal investigator), a research project grant from the National Institute of Mental Health (R01 MH083684, Judith J. Prochaska, principal investigator), and a research award from the California Tobacco-Related Disease Research Program (#13-KT-0152). None of the funding bodies had any role in reviewing or approving the manuscript for publication. The authors thank Howard Liu for his work on the study and his help preparing figures for this manuscript.
Conflicts of Interest
- Bost ML. A descriptive study of barriers to enrollment in a collegiate health assessment program. J Community Health Nurs 2005;22(1):15-22. [CrossRef] [Medline]
- Davies J, McCrae BP, Frank J, Dochnahl A, Pickering T, Harrison B, et al. Identifying male college students' perceived health needs, barriers to seeking help, and recommendations to help men adopt healthier lifestyles. J Am Coll Health 2000 May;48(6):259-267. [CrossRef] [Medline]
- Schonlau M, Zapert K, Simon LP, Sansad KH, Marcus SM, Adams J, Spranca M, Kan H, Turner R, Berry SH. A comparison between responses from a propensity-weighted web survey and an identical RDD survey. Soc Sci Comput Rev 2004;22(1):128-138. [CrossRef]
- Cantrell MA, Lupinacci P. Methodological issues in online data collection. J Adv Nurs 2007 Dec;60(5):544-549. [CrossRef] [Medline]
- Rhodes SD, Bowie DA, Hergenrather KC. Collecting behavioural data using the world wide web: considerations for researchers. J Epidemiol Community Health 2003 Jan;57(1):68-73 [FREE Full text] [Medline]
- Schonlau M, van Soest A, Kapteyn A. Are "Webographic" or attitudinal questions useful for adjusting estimates from Web surveys using propensity scoring? Surv Res Methods 2007;1(3):155-163.
- McCabe SE, Boyd CJ, Couper MP, Crawford S, D'Arcy H. Mode effects for collecting alcohol and other drug use data: Web and U.S. mail. J Stud Alcohol 2002 Nov;63(6):755-761. [Medline]
- Lenhart A, Purcell K, Smith A, Zickuhr K. Social Media and Young Adults. Washington, DC: Pew Internet & American Life Project; 2010 Feb 03 [FREE Full text] [WebCite Cache]
- Muñoz RF, Barrera AZ, Delucchi K, Penilla C, Torres LD, Pérez-Stable EJ. International Spanish/English Internet smoking cessation trial yields 20% abstinence rates at 1 year. Nicotine Tob Res 2009 Sep;11(9):1025-1034. [CrossRef] [Medline]
- Gordon JS, Akers L, Severson HH, Danaher BG, Boles SM. Successful participant recruitment strategies for an online smokeless tobacco cessation program. Nicotine Tob Res 2006 Dec;8 Suppl 1:S35-S41. [Medline]
- Graham AL, Bock BC, Cobb NK, Niaura R, Abrams DB. Characteristics of smokers reached and recruited to an Internet smoking cessation trial: a case of denominators. Nicotine Tob Res 2006 Dec;8 Suppl 1:S43-S48. [Medline]
- Ramo DE, Hall SM, Prochaska JJ. Reaching young adult smokers through the Internet: comparison of three recruitment mechanisms. Nicotine Tob Res 2010 Jul;12(7):768-775. [CrossRef] [Medline]
- Alexa. 2010. Top sites in United States URL: http://www.alexa.com/topsites/countries/US [accessed 2011-06-23] [WebCite Cache]
- Facebook. 2010. Statistics URL: http://www.facebook.com/press/info.php?statistics [accessed 2010-11-06] [WebCite Cache]
- Facebook. 2011. Facebook advertising guidelines URL: http://www.facebook.com/ads/mistakes.php#/ad_guidelines.php [accessed 2011-04-28] [WebCite Cache]
- Facebook. 2011. Delivery: ensuring your ads receive impression and clicks URL: http://www.facebook.com/adsmarketing/index.php?sk=delivery [accessed 2011-04-27] [WebCite Cache]
- Ramo DE, Hall SM, Prochaska JJ. Reliability and validity of self-reported smoking in an anonymous online survey with young adults. Health Psychol 2011 Nov;30(6):693-701. [CrossRef] [Medline]
- Hall SM, Tsoh JY, Prochaska JJ, Eisendrath S, Rossi JS, Redding CA, et al. Treatment for cigarette smoking among depressed mental health outpatients: a randomized clinical trial. Am J Public Health 2006 Oct;96(10):1808-1814. [CrossRef] [Medline]
- Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: toward an integrative model of change. J Consult Clin Psychol 1983 Jun;51(3):390-395. [Medline]
- Hall SM, Havassy BE, Wasserman DA. Commitment to abstinence and acute stress in relapse to alcohol, opiates, and nicotine. J Consult Clin Psychol 1990 Apr;58(2):175-181. [Medline]
Edited by G Eysenbach; submitted 29.06.11; peer-reviewed by M Blankers, J Grohol; comments to author 13.09.11; revised version received 05.12.11; accepted 02.01.12; published 23.02.12
©Danielle E. Ramo, Judith J. Prochaska. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 23.02.2012.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.