Published on 10.03.17 in Vol 19, No 3 (2017): March
Comparison of Different Recruitment Methods for Sexual and Reproductive Health Research: Social Media–Based Versus Conventional Methods
Background: Prior research about the sexual and reproductive health of young women has relied mostly on self-reported survey studies. Thus, participant recruitment using Web-based methods can improve sexual and reproductive health research about cervical cancer prevention. In our prior study, we reported that Facebook is a promising way to reach young women for sexual and reproductive health research. However, it remains unknown whether Web-based or other conventional recruitment methods (ie, face-to-face or flyer distribution) yield comparable survey responses from similar participants.
Objective: We conducted a survey to determine whether there was a difference in the sexual and reproductive health survey responses of young Japanese women based on recruitment methods: social media–based and conventional methods.
Methods: From July 2012 to March 2013 (9 months), we invited women of ages 16-35 years in Kanagawa, Japan, to complete a Web-based questionnaire. They were recruited through either a social media–based (social networking site, SNS, group) or by conventional methods (conventional group). All participants enrolled were required to fill out and submit their responses through a Web-based questionnaire about their sexual and reproductive health for cervical cancer prevention.
Results: Of the 243 participants, 52.3% (127/243) were recruited by SNS, whereas 47.7% (116/243) were recruited by conventional methods. We found no differences between recruitment methods in responses to behaviors and attitudes to sexual and reproductive health survey, although more participants from the conventional group (15%, 14/95) chose not to answer the age of first intercourse compared with those from the SNS group (5.2%, 6/116; P=.03).
Conclusions: No differences were found between recruitment methods in the responses of young Japanese women to a Web–based sexual and reproductive health survey.
J Med Internet Res 2017;19(3):e73
- papillomavirus vaccines;
- reproductive health;
- sexual health;
- sexual behavior;
- uterine cervical neoplasms
Prior research about sexual and reproductive health of young women has largely relied on self-reported survey studies. These surveys are challenging because of their low response rates and the potential bias of their participants .
Low survey response rates are caused by attitudes of young adults toward health issues and their personal lifestyles. Young adults have less interest in health research than older adults, as they have fewer health problems in general and do not perceive themselves to be at risk. Young adults are also extremely mobile during their late teens and 20s because of college, new jobs, or becoming married. Consequently, targeted mailings are not always received. Moreover, computerized assisted telephone interviews are less optimal today, as fewer homes have landlines. Biases can also occur in self-reported sexual and reproductive health surveys and include non-respondent bias and social disability bias . Direct interviews and self-administered questionnaires may be biased in settings such as clinics, schools, and workplaces, even if they are submitted anonymously [ ]. This could be because the participants felt nervous or uncomfortable with the teachers or parents learning about their sexual behavior.
Thus, social media–based recruitment to surveys can potentially improve the low response rate and biases in survey-based sexual and reproductive health research . In a prior study, we reported that social media such as Facebook is a cost-efficient and a promising way to reach a general population of young women for sexual and reproductive health research [ - ]. In addition, Facebook is one of the popular social networking sites (SNSs) worldwide. Unlike the other SNSs such as LINE, mixi, and LinkedIn, Facebook can provide demographic-targeted advertisement (eg, gender, age, or place of residence) using the cost-per-click option, a low-cost system to charge per number of user clicks or views [ ]. We have used Facebook previously in research to recruit general populations of young women, as it is one of the most popular SNSs that young women use to communicate. However, little is known whether social media–based or conventional recruitment methods (ie, face-to-face or flyer distribution) yield comparable survey responses from similar participants [ , ].
We conducted a survey to determine whether there was a difference in the sexual and reproductive health survey responses of young Japanese women based on recruitment methods: social media–based and conventional methods.
This study was a component of a pilot study for the Yokohama-Kanagawa Cervical Cancer Prevention Project . This study protocol was approved by the Institutional Ethics Committee of the Yokohama City University School of Medicine. The detailed methodology of this study was previously reported by Miyagi et al [ ].
We recruited women aged 16-35 years in the Kanagawa Prefecture, Japan, with a population of 9 million, between July 2012 and March 2013 (9 months).
Recruitment Through Facebook
We defined participants recruited through Facebook as the “SNS group.” We recruited them by using a Facebook advertisement in the cost-per-click option.
Recruitment by Conventional Methods
We defined participants recruited through conventional methods as the “conventional group.” The conventional methods used included face-to-face recruitments in clinics and workplaces, and flyer distributions at schools, hospitals, and educational events, which accepted our concept of sexual and reproductive health research.
All participants were invited to access the Yokohama-Kanagawa Cervical Cancer Prevention Project website, through which their personal information was obtained. Subsequently, they were sent a link via email, where they were asked to complete a Web-based questionnaire (SurveyMonkey; SurveyMonkey, Inc).
We asked the participants whether they felt embarrassed by the Web-based survey questions on a scale of 1-5 (1 = not embarrassing, 5 = extremely embarrassing). We also used a chi-square analysis of independence to compare the responses of the two different recruitment groups. We compared the scores between the two groups using Student’s t test. We analyzed the data by SPSS version 20 (IBM Corporation). A P value of < .05 was considered statistically significant.
Attitudes to the Survey Between Recruitment Methods
During the 9-month study period, 394 participants expressed their interests and 264 consented to the study. Among the 243 who completed the Web-based questionnaire, the SNS group (52.3%, 127/243) and the conventional group (47.7%, 116/243) had similar attitudes for all questions regarding their sexual behavior, except for the question regarding the age when they became sexually active. Among those already sexually active (86.8%, 211/243), more participants in the conventional group (15%, 14/95) denied answering the age of their sexual debut, compared with those in the SNS group (5.2%, 6/116) (P=.03;).
|SNS group |
|Conventional group |
|No||Rate (%)||95% CI||No||Rate (%)||95% CI||No||Rate (%)||95% CI||P|
|District of residence|
|< High school graduate||5||2.07||(0.3-3.9)||2||1.57||(0.0-3.7)||3||2.61||(0.0-5.5)||.88|
|High school graduate||47||19.42||(14.4-24.4)||26||20.47||(13.5-27.5)||21||18.26||(11.2-25.3)|
|> High school graduate||190||78.51||(73.3-83.7)||99||77.95||(70.7-85.2)||91||79.13||(71.7-86.6)|
|Sexual and reproductive health|
|Age at first intercourseb|
|Condom use at first sexb|
|Number of sexual partner within 12 monthsb|
|Positive test history for chlamydia among whom they knew chlamydia|
|Awareness of HPV vaccinesb|
|Self-reported cervical cancer screening status among whom their age ≥ 20c|
|Self-reported HPV vaccination status|
|Don’t know/No answer||7||2.88||(0.8-5.0)||3||2.36||(0.0-5.0)||4||3.45||(0.1-6.8)|
aOne participant did not answer this question and was excluded.
bQuestion only for participants who answered \'yes\' to having had sexual experiences.
cOne who answered “I don\'t know” was excluded. The Japanese government invites women aged 20 years and older to cervical cancer screening.
Among women who were sexually active, there was no significant statistical difference in the age of their sexual debut between the two groups (mean age, [SD]), SNS: 19.4 [2.8 years], Conventional: 18.9 [2.6 years], P=.16, by Student’s t test).
Differences in Responses to the Survey Between the Recruitment Methods
There was no statistical difference between the two groups in their responses to questions (embarrassing scores) about the age when they became sexually active, number of sexual partners, regular condom use, sexually transmitted infection, and active use of oral contraceptives ().
Through this study, we found that Japanese women have similar responses to questions regarding sexual behavior and health, regardless of the way in which they were recruited.
We conducted this study in a similar manner to a prior Australian study by Fenner et al , but which did not incorporate conventional methods. We added the conventional methods because we were concerned that there were fewer social media users among Japanese women (72% in their teens and 64% in their 20s) than among Australian women (83% of 16-29-year-old women in 2010) [ ].
Today in Japan (as of April 2016), 25 million people access their Facebook accounts monthly and 64% of them daily . The use of smartphone has increased and encourages the frequent use of SNSs [ ].
In our study, among those who were sexually active, more participants in the conventional group did not respond to the question regarding the age of sexual debut. We do not consider that this difference means a conflict to similarity between recruitment methods. There are three reasons. First, there was no demographic difference between sexually active and nonactive (data not shown). Second, means and SDs of ages of sexual debut were similar between the two groups. Third, attitudes toward the Web-based survey were the same, irrespective of the recruitment method used (). Therefore, we hypothesize that there might be a difference caused by anxiety about anonymity with our conventional methods of recruitment. This hypothesis should be verified by further research.
We can therefore assert that SNSs are promising and efficient tools for participant recruitment for sexual and reproductive health research.
A limitation of this study was that we were able to recruit the SNS group as a randomized sample but not the conventional group. Some participants might have felt nervous about the possibility that their friends, teachers, or coworkers would learn about their sexual behavior, especially among participants in the conventional group. This might have resulted in a difference in the response rate to the question about age of sexual debut.
SNSs have made revolutionary changes in medical research. However, with respect to recruitment of study participants, these changes may be too large or rapid to permit validation of any differences between conventional and SNS-based recruitment methods. In this study, we confirmed similarities between these methods of recruitment for participation in a Web-based sexual and reproductive health survey. Cervical cancer prevention in Japan is declining. This is exemplified by low Papanicolaou cervical cytology screening rates which have resulted in increased cervical cancer mortality and incidence rates among younger Japanese women . Moreover, the suspension of the human papillomavirus (HPV) vaccination promotion by the Japanese government in June 2013 has also decreased the coverage rate for the HPV vaccine from approximately 70% to almost zero [ ]. Evidence-based measures must be taken to overcome the cervical cancer epidemic in Japan. This study confirmed that a nationwide SNS-based survey targeting young Japanese women would be a realistic way to spread information and awareness about cervical cancer prevention.
This study was funded by the Health and Research Grant awarded by the Ministry of Health, Labor and Welfare of Japan (H23-cancer research-general-001 and H26-innovative-cancer research-general-102) and a Japan Agency for Medical Research and Development Grant (15ck0106103h0102). The awarding agency had no role in the study design, data collection, analysis, interpretation of the data, and the decision to submit the manuscript for publication or the writing of the manuscript.
YM and EM wrote the first draft of this manuscript. YM, EM, TE, JDW, and SMG contributed study design and data interpretation. YM and MT contributed data collection, statistical analysis, and quality control. YM, EM, TE, MA, JDW, and SMG contributed to critically reviewing the manuscript.
Conflicts of Interest
- McCallum EB, Peterson ZD. Investigating the impact of inquiry mode on self-reported sexual behavior: theoretical considerations and review of the literature. J Sex Res 2012 Mar 01;49(2-3):212-226. [CrossRef] [Medline]
- Burkill S, Copas A, Couper MP, Clifton S, Prah P, Datta J, et al. Using the web to collect data on sensitive behaviours: a study looking at mode effects on the British National Survey of sexual attitudes and lifestyles. PLoS One 2016 Feb 11;11(2):e0147983 [FREE Full text] [CrossRef] [Medline]
- Miyagi E, Motoki Y, Asai-Sato M, Taguri M, Morita S, Hirahara F, et al. Web-based recruiting for a survey on knowledge and awareness of cervical cancer prevention among young women living in Kanagawa prefecture, Japan. Int J Gynecol Cancer 2014 Sep;24(7):1347-1355 [FREE Full text] [CrossRef] [Medline]
- Heffernan KJ, Chang S, Maclean ST, Callegari ET, Garland SM, Reavley NJ, et al. Guidelines and recommendations for developing interactive eHealth apps for complex messaging in health promotion. JMIR Mhealth Uhealth 2016 Feb 09;4(1):e14 [FREE Full text] [CrossRef] [Medline]
- Callegari ET, Reavley N, Garland SM, Gorelik A, Wark JD. Vitamin D status, bone mineral density and mental health in young Australian women: the Safe-D study. J Public Health Res 2015 Nov 30;4(3):594 [FREE Full text] [CrossRef] [Medline]
- Osborne SL, Tabrizi SN, Brotherton JML, Cornall AM, Wark JD, Wrede CD, et al. Assessing genital human papillomavirus genoprevalence in young Australian women following the introduction of a national vaccination program. Vaccine 2015 Jan 01;33(1):201-208. [CrossRef] [Medline]
- Ahmed N, Jayasinghe Y, Wark JD, Fenner Y, Moore EE, Tabrizi SN, et al. Attitudes to Chlamydia screening elicited using the social networking site Facebook for subject recruitment. Sex Health 2013 Jul;10(3):224-228. [CrossRef] [Medline]
- Gunasekaran B, Jayasinghe Y, Fenner Y, Moore EE, Wark JD, Fletcher A, et al. Knowledge of human papillomavirus and cervical cancer among young women recruited using a social networking site. Sex Transm Infect 2013 Jun 01;89(4):327-329. [CrossRef] [Medline]
- Fenner Y, Garland SM, Moore EE, Jayasinghe Y, Fletcher A, Tabrizi SN, et al. Web-based recruiting for health research using a social networking site: an exploratory study. J Med Internet Res 2012 Feb 01;14(1):e20 [FREE Full text] [CrossRef] [Medline]
- Topolovec-Vranic J, Natarajan K. The use of social media in recruitment for medical research studies: a scoping review. J Med Internet Res 2016 Nov 7;18(11):e286 [FREE Full text] [CrossRef] [Medline]
- The Ministry of Internal Affairs and Communications, Japan. Soumu.go. 2011. Possibilities Engendered by a Symbiotic Networked Society URL: http://www.soumu.go.jp/johotsusintokei/whitepaper/eng/WP2011/chapter-3.pdf#page=1 [accessed 2016-11-25] [WebCite Cache]
- Lifemedia, Inc. Research.lifemedia. 2015 Jun 17. Research of Japanese Facebook users June 2015 URL: http://research.lifemedia.jp/2015/06/150617_facebook.html [accessed 2016-11-25] [WebCite Cache]
- The Ministry of Internal Affairs and Communications, Japan. Soumu.go. 2015 Jul 17. Press release for Internet utilization survey 2014 URL: http://www.soumu.go.jp/johotsusintokei/statistics/data/150717_1.pdf [accessed 2016-11-25] [WebCite Cache]
- Motoki Y, Mizushima S, Taguri M, Takahashi K, Asano R, Kato H, et al. Increasing trends in cervical cancer mortality among young Japanese women below the age of 50 years: an analysis using the Kanagawa population-based Cancer Registry, 1975-2012. Cancer Epidemiol 2015 Oct;39(5):700-706. [CrossRef] [Medline]
- Hanley JBS, Yoshioka E, Ito Y, Kishi R. HPV vaccination crisis in Japan. Lancet 2015 Jun 27;385(9987):2571. [CrossRef] [Medline]
|HPV: human papillomavirus|
|SD: standard deviation|
|SNS: social networking site|
Edited by G Eysenbach; submitted 05.12.16; peer-reviewed by S Tao, K Takahashi; comments to author 25.01.17; revised version received 08.02.17; accepted 10.02.17; published 10.03.17
©Yoko Motoki, Etsuko Miyagi, Masataka Taguri, Mikiko Asai-Sato, Takayuki Enomoto, John Dennis Wark, Suzanne Marie Garland. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 10.03.2017.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.