Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 21.04.15 in Vol 17, No 4 (2015): April

This paper is in the following e-collection/theme issue:

    Original Paper

    A Mixed-Methods Study on the Acceptability of Using eHealth for HIV Prevention and Sexual Health Care Among Men Who Have Sex With Men in China

    1Department of Health Behavior, Gillings School of Global Public Health, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States

    2Icahan School of Medicine at Mount Sinai, New York, NY, United States

    3Department of Epidemiology and Biostatistics, School of Medicine, University of California, San Francisco, San Francisco, CA, United States

    4Department of Health Policy and Management, Gillings School of Global Public Health, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States

    5Division of Infectious Diseases, School of Medicine, The University of North Carolina at Chapel Hill, Chapel Hill, NC, United States

    6Guangdong Provincial Center for Skin Diseases and STI Control & Prevention, Guangzhou, China

    7Guangtong – Lingnan MSM Community Support Center, Guangzhou, China

    Corresponding Author:

    Kathryn E Muessig, AB, PhD

    Department of Health Behavior

    Gillings School of Global Public Health

    The University of North Carolina at Chapel Hill

    306 Rosenau Hall

    Campus Box 7440

    Chapel Hill, NC, 27599

    United States

    Phone: 1 919 962 5059

    Fax:1 919 966 2921

    Email: kmuessig@med.unc.edu


    ABSTRACT

    Background: Human immunodeficiency virus (HIV) infection disproportionately affects men who have sex with men (MSM). Over half of all HIV-positive MSM in China may not know their HIV status. Mobile phones and Web interventions (eHealth) are underutilized resources that show promise for supporting HIV education, testing, and linkage to care.

    Objective: This mixed-methods study among MSM in China assessed technology utilization and eHealth acceptability for sexual health care.

    Methods: We conducted in-depth interviews and an online survey. Qualitative analyses informed the development of the Internet survey, which was administered through two popular MSM websites. Bivariate and multivariate analysis assessed characteristics of MSM interested in eHealth for sexual health care.

    Results: The qualitative sample included MSM across a range of ages, education, marital status, sexuality, and HIV testing experience. Qualitative findings included the importance of the Internet as the primary source of information about sexual health, HIV and other sexually transmitted diseases (STDs), use of the Internet to enable HIV testing opportunities by facilitating connections with both the gay community and health care providers, and mixed perceptions regarding the confidentiality of eHealth tools for sexual health. Among the Internet sample (N=1342), the average age was 30.6 years old, 82.81% (1098/1342) were single, and 53.42% (711/1331) had completed college. In the past 3 months, 38.66% (382/988) had condomless sex and 60.53% (805/1330) self-reported having ever tested for HIV. The majority of men owned computers (94.14%, 1220/1296) and mobile phones (92.32%, 1239/1342), which many had used to search for HIV/STD information and testing sites. In multivariate analysis, interest in using computers or mobile phones to support their sexual health care was associated with being a student, prior use of computers or mobile phones to search for general health information, prior use of computers or mobile phones to search for HIV/STD information, and confidentiality concerns.

    Conclusions: MSM in this sample had high utilization of technology and interest in eHealth despite confidentiality concerns. Future eHealth interventions can thoughtfully and creatively address these concerns as a priority for successful implementation.

    J Med Internet Res 2015;17(4):e100

    doi:10.2196/jmir.3370

    KEYWORDS



    Introduction

    Many men with human immunodeficiency virus (HIV) and who have sex with men (MSM) do not know their HIV status—ranging from around 21% in the United States [1] and New Zealand [2], to over 90% in Malawi [3]. In 2012, China’s national HIV prevalence among MSM reached 6.7% but exceeded 15% in some urban areas [4]. A high national syphilis prevalence around 12% among MSM [5], combined with entrenched fear, stigma, and misunderstanding surrounding HIV and same-sex behavior, inhibit intervention efforts and fuel continued transmission. While government efforts have increased voluntary counseling and testing [6], in 2011 only half of MSM had received an HIV test in the past year and knew their results and as many as 86% of HIV-positive MSM were unaware of their infection [7]. After receiving a positive diagnosis, MSM face delays in care as they pursue required confirmatory and CD4 cell count testing, which are often available only in locations different from the place of original testing and eventual treatment. In this decentralized system, less than half of MSM receive a CD4 count within 6 months of diagnosis [8,9] and under a quarter who qualify for antiretroviral therapy (ART) initiate timely treatment [9]. Delayed linkage to care and suboptimal retention in care hinder effective ART, threaten individual patient outcomes, and may increase the likelihood of onward HIV transmission [10-16].

    The tools provided by widespread Internet access and mobile phone ownership offer a promising approach to reducing these gaps in HIV prevention, testing, and care. eHealth approaches support health care services via a wide range of information and communication technologies including software and hardware, Internet and mobile phone-based resources, and global positioning system (GPS) and tablet technologies. Internet and mobile phone-based components have been successfully used within prevention and care initiatives for HIV and other sexually transmitted diseases (STD) [17-19] including promoting prevention messages [20], facilitating test result notification [21,22], and improving ART adherence and attendance at clinic appointments [23-28]. To date, phone-based HIV interventions have primarily utilized voice or text messaging (SMS) functions [19,25,29,30], but smartphones may further facilitate the delivery of more complex, interactive, and tailored interventions via the mobile Web [31,32] and software apps [33,34]. Smartphones facilitate affordable, widespread access to the Internet, narrowing the “digital divide” such that, by 2011, 68% of Chinese mobile phone owners had smartphones [35].

    MSM-tailored eHealth initiatives are gaining traction in the United States [31,32,34] but have yet to be systematically designed and tested internationally. The hidden nature of MSM in Chinese mainstream society alongside widespread ownership of mobile technology and the growth of sex seeking websites and online dating services [36,37] make mobile technologies an appropriate, familiar medium to address sexual risk and health promotion. Preliminary survey research suggests that MSM in China are willing to provide Internet and mobile phone personal contact information [38]. In order to develop eHealth interventions specifically for Chinese MSM, additional information is needed about Internet and mobile phone ownership, usage, and preferences for sexual health-related services. Building on eHealth lessons learned in development research with at-risk MSM in the United States [31,32], this mixed-methods study explored how Chinese MSM are currently using the Web and mobile Web to find health information and specifically information related to sexual health. We also aimed to characterize men who are currently willing to use eHealth for sexual health care and to identify possible concerns and barriers to using eHealth. The ultimate goal for these research findings is to inform the design of eHealth interventions to address HIV prevention and sexual health care among MSM in China.


    Methods

    Part I: Qualitative Research

    From May to August 2012, we conducted qualitative interviews in two large cities in South China—an area that bears a disproportionate burden of HIV, syphilis, and other STDs especially among MSM [39-43]. The data presented in this manuscript are part of a larger project on MSM testing preferences and experiences. We recruited individuals 16 years of age and older who reported being born biologically male and ever having sex with another man. Participants were recruited through government-sponsored health clinics, non-governmental and community-based organizations, and online through a popular MSM website. We purposively [44] enrolled men across a range of ages, education, marital status, sexuality, and HIV/STD testing experience (never tested, first time being tested, tested multiple times).

    Qualitative interviews included questions on sexual health care and HIV/syphilis testing experiences and preferences. Technology questions addressed mobile phone ownership and capabilities, Internet and mobile phone use, experiences and preferences for using technology for general- and HIV/STD-related health care. The interview guide was pre-tested in mock interviews with volunteers at MSM community-based testing centers and subsequently refined. Eligible participants were interviewed one-on-one by trained, bilingual study staff in private rooms at participating study sites. Interviews were conducted in Mandarin, Cantonese, or English, and recorded with permission. Mobile phone cards and supermarket gift cards worth approximately US $10 were offered as remuneration.

    All qualitative interviews were transcribed verbatim. The analysis team (KEM, CHB, EJL, JDT) developed a structured codebook to help define and illustrate a priori and emergent themes. Two study team members (CHB, EJL) were trained in how to use the codebook and then independently coded all interview transcripts using Atlas.ti, version 7.0. These coded transcripts were merged and reviewed by a third coder (KEM) for fidelity to the codebook and consistency between coders. No major differences in code applications were identified. All relevant coded data were then reviewed theme by theme and relationships between themes were described. Illustrative quotes were chosen by group consensus to present typical responses and variation within each theme. The findings are organized into four sections as follows: qualitative sample characteristics, the Internet as a primary source of information about sexual health and HIV/STDs, the role of the Internet in facilitating HIV/STD testing, and concerns and considerations for using eHealth for sexual health care among MSM in China.

    Part II: Internet Survey

    The qualitative findings informed the design of an Internet-based survey. Survey development was supported by sociologists who conduct the Chinese national survey of sexual behavior [45,46]. The questions were reviewed by four local MSM community volunteers and one focus group discussion. The online survey administration system was pilot tested among 201 MSM (data not included in final analysis). The final survey tool contained 225 possible questions and took an average of 20 minutes to complete. In addition to sociodemographic information, the survey content covered six broad topics: (1) condom and lubrication preferences (results not shown), (2) drug and alcohol use (results not shown), (3) sexual behavior, (4) HIV/STD testing, (5) technology ownership/use, and (6) interest in using eHealth tools for sexual health and confidentiality concerns of using eHealth for sexual health.

    In May 2013, the Internet survey was hosted by two high-traffic Web portals: GZTZ.org (Guangzhou) and manbf.com (Chongqing, now manbf.net). These sites were chosen for their hosts’ geographic diversity and widespread popularity among MSM across China. Both websites are run by community-based, MSM-focused organizations founded in 1998 and have social networking and microblogging features. They also advertise MSM-geared products and events, and provide information and services to promote HIV/STD education and testing. Both organizations are community partners with the local Chinese Centers for Disease Control and have received support from international donors including the Global Fund to Fight AIDS, Tuberculosis and Malaria. Guangzhou tongzhi (GZTZ), also known as the Lingnan Group, has been a partner of the China-Gates Foundation HIV Prevention Cooperation Program since 2008. In 2010, GZTZ.org recorded over 3.5 million unique visitors. An assessment of GZTZ users in 2010 found that among 1100 participants, the average age was 30 years old, 93% lived in Guangdong Province, 77.9% self-identified as gay, and 80% had attained a college degree [47]. Manbf.net is the website for the Chongqing Tongxin Working Group and had over 10,000 registered users in 2011.

    Banner ads were posted on the Web portal home pages (see Multimedia Appendices 1 and 2). Participants who clicked on the banner ad were taken to a welcome page describing the survey. Those who chose to continue completed an informed consent screener. Consented participants were asked three eligibility questions: born biologically male, at least 16 years old (age of consent in China), and had ever had anal sex with men.

    To complete the survey via GZTZ.org, participants had to register and log in. A list of user names was kept (unaffiliated with survey responses) to deter men from completing the survey more than once. In keeping with GZTZ’s past survey research, survey completers were awarded 500 website credits and 50 site “loyalty points” that can be used to “unlock” additional social media features of the GZTZ website. Following the standard practice of the Chongqing Tongxin Working Group at the time, participants recruited through the manbf website were not required to log in and did not receive incentive points.

    Frequencies (Table 1) were conducted to describe sociodemographic characteristics, HIV/STD sexual transmission behaviors, and use of computers and mobile phones. To measure interest in using technology as part of their sexual health care, participants were asked to respond “very interested”, “somewhat interested”, or “not interested” for each of the following six items: receiving HIV testing reminders by SMS/text message, receiving HIV testing reminders by QQ (the most popular Chinese chat and instant messaging service) or email, sexual health counseling by online chat, receiving sexual health education via websites, receiving sexual health education via mobile phone apps, and receiving sexual health education via Internet/mobile phone games. Participants who reported being “very interested” in one or more of these six questions were categorized as having “interest in eHealth”, and this variable was used as the main outcome of interest. This decision was made in order to better understand the most likely users for targeting future eHealth interventions.

    Univariate and multivariate associations were calculated using logistic regression. A backward elimination process was used to build multivariate models from the variables listed in the tables, with a P value of <.10 required for retention in the final model. We assessed collinearity using the variance inflation factor. All statistical analyses were conducted using SPSS, version 21.

    The Institutional Review Boards of the Guangdong Provincial STD Control Center, the London School of Hygiene and Tropical Medicine, and the University of North Carolina at Chapel Hill approved this study. See Multimedia Appendix 3 for the Checklist for Reporting Results of Internet E-Surveys (CHERRIES).

    Table 1. Demographic characteristics of a qualitative and Internet sample of MSM in China.
    View this table

    Results

    Qualitative Sample Characteristics

    Overview

    Qualitative interviews were conducted with 35 MSM aged 16-48 who were living in Guangzhou and Hong Kong at the time of study recruitment, but whose hometowns represented nine Chinese provinces and Hong Kong. Seven men had never tested for HIV, 7 men had tested for the first time on the day of their interview, and 21 men had tested multiple times. Twenty-eight men self-identified as gay, 4 as bisexual, and 3 chose not to specify. Most participants were unmarried, currently working, and had at least some education beyond high school.

    The Internet as a Primary Source of Information About Sexual Health and HIV/STDs

    Technology ownership and use was widespread in both the qualitative and Internet survey samples. In the qualitative sample, all men owned a mobile phone, the majority of which were smart phones (27/35). Overall, men had a positive response for using phones and the Internet for sexual health. The most common theme was the level of convenience provided for finding information and getting tested. During the interviews, all men reported using mobile phones or computers to search for general health information, and just over half of the men described examples of finding HIV/STD information online for themselves or for friends through community organizations’ websites and other sources:

    MSM community organizations’ websites are very important, they contain comprehensive information…about symptoms, characteristics, the window period etc. When my friend was infected with gonorrhea, I actually went online to look up information for him.
    [B04, gay, multi-time tester, age 27]

    Notably, the Internet was the primary source of HIV/STD information for many men:

    R: Did you know much about HIV or syphilis testing before you looked it up online?
    I: No. I searched all the information online first…lots of the knowledge I’ve known until now was from the Internet…Like how to protect yourself. What tools that you can use to protect you and your partner while you are having sex. And HIV information, like today, I searched for organizations to have tests.
    [A02, gay, multi-time tester, age 24]

    In the qualitative interviews, 15 men explicitly remembered using their mobile phones to look up sexual health information via mobile search engines (Baidu, Yahoo, Google, Weibo) and blogs.

    The Internet Facilitated HIV/STD Testing

    The Internet facilitated HIV/STD testing by providing information about testing and assistance finding testing facilities; creating safe spaces for men to share testing experiences and information about doctors; exposing men to direct HIV/STD test advertising from community organizations, hospitals and health departments; and providing online appointment scheduling and reminders. For many men, learning about HIV/STD testing happened as they were trying to learn about being gay or connecting with the tongzhi (gay men) community. As men learned about and connected with the tongzhi community online, they were also exposed to HIV/STD information, stories, advertisements, and services targeting MSM:

    On the Internet I learned tongzhi is a population with high risk. I got the [testing center’s] address on its website and called to make an appointment…It was a service organization particularly for tongzhi. I am afraid of the way people would look at me if I go to the normal hospital.
    [A18, gay, multi-time tester, age 41]

    The Internet also provided opportunities to exchange testing experiences and information about doctors. Men used online recommendations, stories, and reviews to make decisions about testing: “Each place offering testing has its own website. I will look at users’ comments. If the majority of them agree that a place is good, then that would be my choice” (A17, bisexual, first time tester, age 23).

    Men who were connected to the online tongzhi community knew that there were service organizations that would provide free, MSM-tailored testing services and described how they used the Internet as a resource to find these services:

    If I had a symptom, let’s say persistent low fever, then it’s possible that I was [HIV] positive, and I’d need to have a test. Instead of going to private doctors where I have to pay, I would probably first go online and look up organizations that provide testing for the gay community. Because they are providing the rapid test for free and have better privacy.
    [B07, gay, never tested, age 35]

    From a practical standpoint, men used their phones and computers to make testing appointments online, get appointment reminders by text message/SMS, and receive test results by phone call, SMS, or secure website: “Today I used my mobile phone to make my appointment…quite a good experience. Our community organization would inform us when we make an appointment. We would receive text reminders before the appointment telling us the time and duration” (A09, gay, multi-time tester, age 35).

    Concerns and Considerations

    In spite of widespread use and interest in eHealth for sexual health, men also expressed concerns, most commonly around privacy and confidentiality in the need to protect HIV/STD health information from one’s direct social contacts (ie, family, friends, and coworkers) and the general public and government. At the level of privacy from family, friends, and coworkers, the primary concern was that others would directly see HIV/STD information on participants’ phones or computers. This concern also applied to the use of HIV/STD-related mobile phone apps: “I would be a little bit worried about [this information] being on my mobile phone. After all, I’m afraid that somebody will see, and worry about leaks of privacy” (A26, bisexual, multi-time tester, age 48) and “I’ve actually seen some apps [for HIV]…I find them interesting but I will not download them…I sometimes lend my phone to friends for fun. Therefore I would worry they would see those apps” (B01, gay, multi-time tester, age 23).

    Participants who already used their computers and phones to search for sexual health information described the protective measures they took including clearing search history, deleting messages, and using phone and Internet passwords. A further recommendation was that future services should use discrete language: “Some people might fear that the messages would be seen by others. That language… could be organized in a way that protects the information, so that other people can’t tell what it’s about” (A20, bisexual, first time tester, age 21).

    Men were also concerned about protecting their HIV/STD health information from the general public and the government. In these conversations, phones could help or hinder privacy:

    There isn’t much to say about the confidentiality of text messages in China. As you know, all your emails and phone calls can be read or heard by others.
    [A12, gay, multi-time tester, age 28]
    Actually, it’s the security of hospital data worth worrying about. In mainland China we have done a poor job of keeping the CDC and hospital data private. Such institutions call patients’ names when it’s ones’ turn to get tested – it’s a big risk for leaking the name of infected patients to the public. Even if the information is not leaked further, it’s still embarrassing. So, the mobile phone security does a better job since only the CDC staff can phone you.
    [A07, gay, multi-time tester, age 33]

    Beyond privacy protection, many men also worried about the trustworthiness of online information: “I believe 60% of the websites, which means I suspect 40%. I think a formal website has higher credibility” (A04, bisexual, multi-time tester, age 21). As this man describes, formal sites were perceived as more trustworthy, including familiar MSM organizations and government-supported organizations: “You can search online at China Red Cross and you can search some very official sites like the Guangdong Provincial Health Department. If it’s got ‘Province’ or ‘City’ in the title then it’s official, it can be trusted” (A02, gay, multi-time tester, age 24).

    Internet Survey Sample

    For the Internet survey, 3378 participants clicked on the initial link to read about the survey. Among these, 60.49% (2044/3378) consented to participate in the survey. Within these 2044, 6.60% (135/2044) were not eligible due to being born female (5.2%, 7/135), being under the age of 16 (8.1%, 11/135), or reporting never having had sex with a man (86.7%, 117/135). Of the remaining 1909 eligible participants, 1342 (70.30%) finished the survey.

    At the time of taking the survey, 59.54% (799/1342) of participants were living in Guangzhou City and 9.24% (124/1342) were living in Chongqing City. Regarding registered residence permit status at the time of the survey: 30.48% (409/1342) were registered in Guangzhou City and 8.87% (119/1342) were registered in Chongqing City (Table 1). For the Internet sample overall, average age was 30.6 years old (range 16-64). Over half of the sample was between 21 and 30 years old. Although the majority of men were single, 64.86% (860/1326) reported living with others (roommates, girlfriend, boyfriend, coworkers, family). Most men had completed an education of college or beyond, and 9.54% (128/1342) were currently full-time students. About three quarters of the sample self-identified as tongzhi (gay). Annual income varied with 27.97% (374/1337) earning less than US $6000 per year. Over one-third of men had never tested for HIV. Among those who had tested and knew their results, 6.1% (49/805) were HIV-positive. A substantial proportion of men reported having condomlesss sex with men (38.7%, 382/988) or women (11.93%, 159/1333) in the past 3 months (Table 1) including 39% (19/49) of men who reported being HIV-positive.

    All of our qualitative findings were confirmed in the Internet survey (Table 2): 92.32% (1239/1342) of survey respondents owned a mobile phone or a smartphone and 94.14% (120/1296) owned a computer. The majority (88.05%, 1009/1146) of men connected to the Internet at least once a day and 83.71% (956/1142) used mobile phone apps at least once a day. In the online survey, men reported using computers and mobile phones to search online for general health information (computer: 63.65%, 746/1172; mobile phone: 41.48%, 465/1121) as well as specific information about HIV/STDs (computer: 51.80%, 603/1164; mobile phone: 27.64%, 306/1107).

    Most men expressed interest in using eHealth modalities for sexual health (Table 2), including receiving HIV testing reminders by SMS/text message, or QQ chat/email; sexual health counseling by online chat; and sexual education via websites, mobile phone apps, or Internet/mobile phone games. Overall 43.89% (589/1342) of men were very interested in at least one of these eHealth modalities (main outcome), and 29.06% (390/1342) were somewhat or very interested in all six items.

    Table 2. Computer and mobile phone usage and acceptability of technology-based sexual eHealth intervention among 1342 MSM in China (N=1342a).
    View this table

    In bivariate analysis (Table 3), being very interested in using computers or mobile phones for sexual health was positively associated with student status, lower annual income, past HIV testing, being self-reported HIV-positive, daily mobile phone app use, daily Internet use, past use of computers or mobile phones to find HIV/STD information or testing sites, past use of computers or mobile phones to find general health information, and confidentiality concerns about using eHealth for sexual health.

    Table 3. Correlates of interest in technology for sexual health among 1342 MSM in China.
    View this table

    In multivariate analysis (Table 3), four variables remained significantly associated with interest in eHealth: student status (adjusted OR 2.27, 95% CI 1.24-4.16, P=.008), past use of eHealth (mobile phone or computer) to search for HIV/STD information or testing site (adjusted OR 2.11, 95% CI, 1.53-2.90, P<.001), past use of eHealth to search for general health information (other than HIV/STDs) (adjusted OR 1.70, 95% CI 1.23-2.33, P=.001), and having any confidentiality concerns related to eHealth (adjusted OR 3.70, 95% CI 2.47-5.54, P<.001).


    Discussion

    Principal Findings

    The purpose of this mixed-methods study among a total of 1377 MSM across multiple sites in China was to conduct formative work to inform the development of future eHealth interventions. We found high ownership, utilization, and interest in computer and mobile phone–based tools to support sexual health care, showing promise for the expansion of eHealth HIV/STD interventions among MSM in China. In this Internet-based sample, MSM who expressed interest in the use of eHealth as part of their sexual health care were more likely to have previously used mobile phones or computers to find HIV/STD information but also had confidentiality concerns about eHealth. Evidence from our qualitative sample elucidated ways men are already using these tools and how they facilitated connections to HIV/STD testing and health services. eHealth tools address barriers to better HIV/STD prevention, linkage to care, and treatment. In particular, men in our sample described how the tools of eHealth addressed barriers to prevention and care activities for them. For example, the Internet provided a way to find testing sites and schedule appointments (removing logistical barriers), identify free services (removing financial barriers), and reduce fear of testing via reading about other men’s testing experiences (removing psychosocial barriers).

    Our findings speak directly to a recent study among 404 MSM in China that found a lack of HIV testing was associated with not knowing where to get tested, limited HIV knowledge, low perceived HIV risk, concerns about the confidentiality of HIV testing, not being openly gay, not using the Internet, and not having others who had tested for HIV in their social network [48]. Our qualitative interview findings show how Internet use among MSM in China is already addressing each of these barriers and suggest ways for expanding future eHealth interventions. For most men in our qualitative sample, the Internet was an equally, if not more important source of information about HIV/STDs and testing sites than close friends or health professionals. Men gleaned information from formal sites (health departments, hospitals, community-based organizations) as well as blogs and posts of other men’s experiences, reviews, and recommendations. Online advertisements, information, and direct invitations from MSM community-based organizations successfully prompted some MSM to get HIV/STD testing.

    Importantly, interactive multimedia has high appeal across gender, culture, and age groups. eHealth modalities are now being used to deliver and address many aspects of HIV prevention including in diverse settings in China such as Web-based HIV/AIDS education and stigma reduction intervention in rural areas [49] and sex education and awareness raising among urban youth [50]. Community-based MSM organizations in China are already trying these technologies. For example, a mobile phone social and sexual networking app called Blued (similar to Jack’d) has been used to promote HIV testing among MSM in Beijing [51]. In addition, the GZTZ organization has created an online program called “Yigaozhi” (Easy to Tell), which helps HIV-positive MSM with status disclosure and HIV test promotion among their sexual partners [52]. The benefits offered by eHealth include broad reach and accessibility to wide audiences; the ability to create interventions that are brief, flexible, and tailored to individual users; and cost savings through scalability, widespread dissemination, and reduced burden compared to face-to-face interventions.

    As highlighted in our qualitative interviews, men were aware of the varying quality of information provided online and had developed strategies for coping with this complication including seeking information from sources they perceived to be more “official” such as the Red Cross or provincial-level websites. Credibility is an important consideration in developing eHealth interventions for MSM in China in terms of choosing where and how information will be delivered. There is also room for future research that assesses the accuracy of health information currently being provided by popular MSM websites in China.

    Many men accessed the Internet via their mobile phones to look up sexual health information, make appointments, and receive HIV/STD testing information and/or test results. However, overall lower access of the Internet by mobile phone (as compared to computers) in the context of high smartphone ownership indicates an area for development and expansion in optimizing Web and mobile phone apps to make online information more accessible and user-friendly via mobile phones. MSM websites and online services should be visually optimized for mobile phone access to get the broadest use in real-time. Additional tools for future adaptation and development could include websites that include more interactive features, peer and/or health provider facilitated QQ groups and online forums, expansion of reminder and result notification texting/SMS programs, GPS-enabled apps for locating free HIV/STD testing and condoms (eg, NYC Condom, Philly Condom), and mobile phone apps to support HIV care appointments and medication adherence. For example, most men found out about HIV/STD testing online and many men had used online services to schedule appointments. However, there was often a time lag of months or even years between learning about testing and getting tested. This suggests an opportunity for an eHealth-based tool that would facilitate linkage between awareness of testing and actual testing. This kind of tool could include elements such as online personal risk assessment quizzes and automated or personalized follow-up test scheduling prompts and reminders.

    To reach the widest population of MSM, eHealth approaches for HIV/STD testing and care should offer a variety of modalities (calls, text/SMS, Web-based resources, online chats/forums, apps, etc) and services. In our Internet survey, MSM preferences for eHealth modalities varied. Sexual health websites, online chat, and mobile phone apps were the most popular. Furthermore, in the qualitative sample, men described a wide variety of ways that they used online HIV/STD information and services. For successful intervention, the mode of eHealth delivery matters. For example, a 2008 randomized controlled trial designed to reduce HIV risk among MSM in Hong Kong failed to achieve significant changes in any of the intervention outcomes [53]. This intervention was primarily delivered to participants by email and followed an information format. Similarly, a multicomponent sexual education Internet-based intervention found that both the email and discussion board features of the intervention were underutilized [50]. In further support of the importance of delivery mode, Zou et al found that MSM in China who were recruited through instant messaging (QQ), online chat, and mobile phone contact (text, SMS) were significantly more likely to actually go and get tested compared to men who were recruited via email [54].

    In general, MSM in our study were willing to use their phones to get HIV/STD information and services, but many were concerned about confidentiality and privacy. In the Internet sample, interest in eHealth was strongly associated with confidentiality concerns. This finding may seem counterintuitive; however, it may also signify an unmeasured confounder or construct such as prior negative experiences with breach of confidential health information within the mainstream medical system or general concern about monitoring of the Internet. Further work is needed to better understand the sources of these concerns and how they might be addressed. In the qualitative sample, participants expressed a range of opinions regarding the security of accessing and retaining health information by Internet and on their phones. While some men were concerned about the confidentiality of health information exchanged by phone, others felt that phones were more confidential than paper records or in-person consultations. Those who were using phones and computers for sexual health suggested a range of solutions to protect confidential information including using indirect language, keeping phones locked, and regularly deleting messages and browser history. Overall, men’s confidentiality concerns emphasize the importance of sensitivity to this issue as well as building and clearly communicating security features of future eHealth interventions for MSM in China.

    Limitations

    This study is subject to several limitations. Internet- and venue-based samples are subject to different kinds of recruitment bias. While we cannot quantify the extent of these biases, a strength of our study lies in its use of both recruitment modes and sample findings that mutually reinforced each other, increasing the reliability of both samples. Two additional questions of greatest interest that address the validity of using our findings for intervention recommendations are (1) Does Internet-based recruitment of Chinese MSM capture an appropriate at-risk population for HIV/STD intervention? and (2) How representative is our sample of the broader population of Internet-using MSM in China? In our online sample, men reported high levels of condomless sex with men and women, and low levels of HIV testing. This finding reinforces previous research among MSM in China that found high levels of sexual risk behaviors among Internet-based samples [55-57]. Furthermore, evidence of heightened risk of HIV has been demonstrated among MSM in China who use the Internet. Among a sample of 77 recently diagnosed HIV-positive MSM, 58.4% had found sex partners via the Internet during the year leading up to their infection [58], and among 307 young migrant MSM, men recruited via the Internet had higher prevalence of HIV as compared to those recruited from venues, peer outreach, or network referrals [59].

    The health education promotion activities on the two survey host websites may also create a source of bias whereby our recruited participants had higher willingness to utilize eHealth interventions (as compared to the general population of Internet-using MSM). While this is possible, our study found that in spite of exposure to these websites, 38.7% of survey respondents reported condomless sex in the past 3 months and 39.5% had never been tested for HIV. These continued risk behaviors among MSM who are utilizing websites that promote health activities suggest that there is room for intensified or adapted eHealth intervention activities targeting this population. Furthermore, our study does not specifically address MSM who do not have access to (or choose not to use) the Internet and/or mobile smartphones. While likely a growing minority in China’s rapidly expanding technology market, these men also need continued, targeted outreach as they are likely to be overrepresented in the lowest socioeconomic strata of MSM in China [5,57].

    An additional limitation of our study was the different completion rates between our two recruitment sites. Among screened, eligible participants, 36.5% of Chongqing participants went on to complete the survey versus 78.6% of Guangzhou participants. However, for potential participants who completed the initial screener questions (sex assigned at birth, current self-identified gender, lifetime unprotected anal intercourse, age), we found no significant difference between sites and between those who went on to take the survey versus those who did not. We suspect the difference in the proportion of those who went on to take the survey was most directly related to the lack of incentive provided for the Chongqing participants. One goal in conducting the study was to be least disruptive to the current norms among these well-established online MSM communities. Therefore, we followed each organization’s standard practice for remuneration in keeping with their prior research and site management conventions. Given the minor nature of the incentive provided (no money or physical item directly given), we do not feel that the incentive would have caused a meaningful difference in the characteristics of who completed the survey. In addition, we found no association between recruitment site and our outcome variable. We also conducted a sensitivity analysis including recruitment site in the multivariate model and found no significant differences (data not shown). Nevertheless, the varying survey completion rate is an important finding on its own as future Internet-based surveys that attempt to utilize multiple recruitment platforms will face similar questions of following existing remuneration practices versus imposing other standards. It is also promising to note that even a small, non-monetary incentive can serve as sufficient remuneration for eliciting high online survey participation.

    Conclusions

    To date, meta-analyzed results of interventions among MSM in China have shown significant changes in HIV knowledge and sexual risk behaviors but have not achieved the hoped-for level of change in HIV incidence [60]. The field of HIV prevention is shifting to combination approaches with greater consideration of social and structural risk factors as well as incorporation of biomedical advances (eg, point-of-care rapid HIV, CD4, and viral load testing; ART treatment as prevention, pre-exposure prophylaxis), alongside traditional individual-level education and behavior. Our study has implications for the new “test and treat” models that are being promoted as part of these comprehensive HIV intervention strategies [61]. eHealth interventions can capitalize on the social networking and support available through the Internet and can play a key role along each step of the HIV testing and care cascade from connecting participants to testing centers to helping HIV-infected persons with daily medication adherence [62]. For individual-level interventions, formative work—as we have reported here—and pilot testing among the study population are critical steps for identifying the best modes and messages to improve the chances of intervention efficacy and acceptability. Although Internet and mobile phones are ubiquitous in China, their full potential has not yet been optimally employed to support health interventions for HIV/STD prevention, testing, linkage, and care. eHealth interventions could capitalize on widespread mobile phone ownership and build on preliminary work that establishes the acceptability and current use of these technologies to support MSM health and sexual health in particular.

    Acknowledgments

    This research was supported by an NIH Career Development Award (1K01TW008200), an NIH institutional training grant (5T32AI007001-35), the UNC Center for AIDS Research (NIAID 5P30AI050410-13), the Partnership for Social Science Research on HIV/AIDS in China (NICHD 1R24 HD056670-04), a junior faculty award from the American Society of Tropical Medicine and Hygiene/Burroughs Welcome Fund, Columbia University College of Physicians and Surgeons Dean’s International Grant, Harvard Medical School, IDSA Medical Scholars Program, and a grant from the Doris Duke Charitable Foundation to UNC-Chapel Hill. We would also like to thank SESH Global (www.seshglobal.org) for technical support.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Survey banner advertisement ("Participate in this survey to quickly earn 50 loyalty points. NEW!").

    JPG File, 214KB

    Multimedia Appendix 2

    Survey banner advertisement ("Survey click here to attend: Understanding MSM's experience and perspectives about testing and obtaining sex products").

    JPG File, 241KB

    Multimedia Appendix 3

    Checklist for Reporting Results of Internet E-Surveys (CHERRIES).

    PDF File (Adobe PDF File), 94KB

    References

    1. Chen M, Rhodes PH, Hall IH, Kilmarx PH, Branson BM, Valleroy LA, Centers for Disease Control and Prevention (CDC). Prevalence of undiagnosed HIV infection among persons aged ≥13 years--National HIV Surveillance System, United States, 2005-2008. MMWR Morb Mortal Wkly Rep 2012 Jun 15;61 Suppl:57-64 [FREE Full text] [Medline]
    2. Saxton PJW, Dickson NP, Griffiths R, Hughes AJ, Rowden J. Actual and undiagnosed HIV prevalence in a community sample of men who have sex with men in Auckland, New Zealand. BMC Public Health 2012;12:92 [FREE Full text] [CrossRef] [Medline]
    3. Wirtz AL, Jumbe V, Trapence G, Kamba D, Umar E, Ketende S, et al. HIV among men who have sex with men in Malawi: elucidating HIV prevalence and correlates of infection to inform HIV prevention. J Int AIDS Soc 2013;16 Suppl 3:18742 [FREE Full text] [Medline]
    4. 2012 China AIDS Response Progress Report. 2012.   URL: http:/​/www.​unaids.org/​en/​dataanalysis/​knowyourresponse/​countryprogressreports/​2012countries/​ce_CN_Narrative_Report%5B1%5D.​pdf [accessed 2014-02-17] [WebCite Cache]
    5. Wu Z, Xu J, Liu E, Mao Y, Xiao Y, Sun X, National MSM Survey Group. HIV and syphilis prevalence among men who have sex with men: a cross-sectional survey of 61 cities in China. Clin Infect Dis 2013 Jul;57(2):298-309 [FREE Full text] [CrossRef] [Medline]
    6. Zou H, Hu N, Xin Q, Beck J. HIV testing among men who have sex with men in China: a systematic review and meta-analysis. AIDS Behav 2012 Oct;16(7):1717-1728. [CrossRef] [Medline]
    7. Li X, Lu H, Raymond HF, Sun Y, Jia Y, He X, et al. Untested and undiagnosed: barriers to HIV testing among men who have sex with men, Beijing, China. Sex Transm Infect 2012 Apr;88(3):187-193. [CrossRef] [Medline]
    8. Zhang Y, Lu L, Li HQ, Liu W, Tang ZR, Fang H, et al. Engaging HIV-infected patients in antiretroviral therapy services: CD4 cell count testing after HIV diagnosis from 2005 to 2009 in Yunnan and Guangxi, China. Chin Med J (Engl) 2011 May;124(10):1488-1492. [Medline]
    9. Lambdin B, Cai T, Udoh I. Identifying bottlenecks: loss to follow-up of MSM from HIV testing to treatment in Wuhan, China. USA: Abstract #LBPE51; 2012 Presented at: XIX International AIDS Conference; July 22-27, 2012; Washington, DC   URL: http://pag.aids2012.org/Abstracts.aspx?AID=21557
    10. Thompson MA, Aberg JA, Hoy JF, Telenti A, Benson C, Cahn P, et al. Antiretroviral treatment of adult HIV infection: 2012 recommendations of the International Antiviral Society-USA panel. JAMA 2012 Jul 25;308(4):387-402. [CrossRef] [Medline]
    11. Moore DM, Hogg RS, Yip B, Wood E, Tyndall M, Braitstein P, et al. Discordant immunologic and virologic responses to highly active antiretroviral therapy are associated with increased mortality and poor adherence to therapy. J Acquir Immune Defic Syndr 2005 Nov 1;40(3):288-293. [Medline]
    12. Cohen MS, Chen YQ, McCauley M, Gamble T, Hosseinipour MC, Kumarasamy N, HPTN 052 Study Team. Prevention of HIV-1 infection with early antiretroviral therapy. N Engl J Med 2011 Aug 11;365(6):493-505 [FREE Full text] [CrossRef] [Medline]
    13. Cohen MS, Muessig KE, Smith MK, Powers KA, Kashuba AD. Antiviral agents and HIV prevention: controversies, conflicts, and consensus. AIDS 2012 Aug 24;26(13):1585-1598 [FREE Full text] [CrossRef] [Medline]
    14. Del RJ, Castilla J, Hernando V, Rodríguez C, García S. Combined antiretroviral treatment and heterosexual transmission of HIV-1: cross sectional and prospective cohort study. BMJ 2010;340:c2205 [FREE Full text] [Medline]
    15. Quinn TC, Wawer MJ, Sewankambo N, Serwadda D, Li C, Wabwire-Mangen F, et al. Viral load and heterosexual transmission of human immunodeficiency virus type 1. Rakai Project Study Group. N Engl J Med 2000 Mar 30;342(13):921-929. [CrossRef] [Medline]
    16. Attia S, Egger M, Müller M, Zwahlen M, Low N. Sexual transmission of HIV according to viral load and antiretroviral therapy: systematic review and meta-analysis. AIDS 2009 Jul 17;23(11):1397-1404. [CrossRef] [Medline]
    17. Lim MSC, Hocking JS, Hellard ME, Aitken CK. SMS STI: a review of the uses of mobile phone text messaging in sexual health. Int J STD AIDS 2008 May;19(5):287-290. [CrossRef] [Medline]
    18. Mukund BKC, Murray PJ. Cell phone short messaging service (SMS) for HIV/AIDS in South Africa: a literature review. Stud Health Technol Inform 2010;160(Pt 1):530-534. [Medline]
    19. Ybarra ML, Bull SS. Current trends in Internet- and cell phone-based HIV prevention and intervention programs. Curr HIV/AIDS Rep 2007 Dec;4(4):201-207. [Medline]
    20. Cornelius JB, Cato M, Lawrence JS, Boyer CB, Lightfoot M. Development and pretesting multimedia HIV-prevention text messages for mobile cell phone delivery. J Assoc Nurses AIDS Care 2011;22(5):407-413 [FREE Full text] [CrossRef] [Medline]
    21. Cornelius JB, Cato MG, Toth JL, Bard PM, Moore MW, White A. Following the trail of an HIV-prevention Web site enhanced for mobile cell phone text messaging delivery. J Assoc Nurses AIDS Care 2012;23(3):255-259 [FREE Full text] [CrossRef] [Medline]
    22. Lim EJ, Haar J, Morgan J. Can text messaging results reduce time to treatment of Chlamydia trachomatis? Sex Transm Infect 2008 Dec;84(7):563-564. [CrossRef] [Medline]
    23. Lester RT, Ritvo P, Mills EJ, Kariri A, Karanja S, Chung MH, et al. Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): a randomised trial. Lancet 2010 Nov 27;376(9755):1838-1845. [CrossRef] [Medline]
    24. Hardy H, Kumar V, Doros G, Farmer E, Drainoni ML, Rybin D, et al. Randomized controlled trial of a personalized cellular phone reminder system to enhance adherence to antiretroviral therapy. AIDS Patient Care STDS 2011 Mar;25(3):153-161 [FREE Full text] [CrossRef] [Medline]
    25. Horvath T, Azman H, Kennedy GE, Rutherford GW. Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection. Cochrane Database Syst Rev 2012;3:CD009756. [CrossRef] [Medline]
    26. da Costa TM, Barbosa BJP, Gomes e Costa Durval A, Sigulem D, de Fátima MH, Filho AC, et al. Results of a randomized controlled trial to assess the effects of a mobile SMS-based intervention on treatment adherence in HIV/AIDS-infected Brazilian women and impressions and satisfaction with respect to incoming messages. Int J Med Inform 2012 Apr;81(4):257-269 [FREE Full text] [CrossRef] [Medline]
    27. Pop-Eleches C, Thirumurthy H, Habyarimana JP, Zivin JG, Goldstein MP, de WD, et al. Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders. AIDS 2011 Mar 27;25(6):825-834 [FREE Full text] [CrossRef] [Medline]
    28. Dowshen N, Kuhns LM, Johnson A, Holoyda BJ, Garofalo R. Improving adherence to antiretroviral therapy for youth living with HIV/AIDS: a pilot study using personalized, interactive, daily text message reminders. J Med Internet Res 2012;14(2):e51 [FREE Full text] [CrossRef] [Medline]
    29. Swendeman D, Rotheram-Borus MJ. Innovation in sexually transmitted disease and HIV prevention: internet and mobile phone delivery vehicles for global diffusion. Curr Opin Psychiatry 2010 Mar;23(2):139-144 [FREE Full text] [CrossRef] [Medline]
    30. Juzang I, Fortune T, Black S, Wright E, Bull S. A pilot programme using mobile phones for HIV prevention. J Telemed Telecare 2011;17(3):150-153. [CrossRef] [Medline]
    31. Hightow-Weidman LB, Pike E, Fowler B, Matthews DM, Kibe J, McCoy R, et al. HealthMpowerment.org: feasibility and acceptability of delivering an internet intervention to young Black men who have sex with men. AIDS Care 2012;24(7):910-920 [FREE Full text] [CrossRef] [Medline]
    32. Muessig KE, Pike EC, Fowler B, LeGrand S, Parsons JT, Bull SS, et al. Putting prevention in their pockets: developing mobile phone-based HIV interventions for black men who have sex with men. AIDS Patient Care STDS 2013 Apr;27(4):211-222 [FREE Full text] [CrossRef] [Medline]
    33. Ramanathan N, Swendeman D, Comulada WS, Estrin D, Rotheram-Borus MJ. Identifying preferences for mobile health applications for self-monitoring and self-management: focus group findings from HIV-positive persons and young mothers. Int J Med Inform 2013 Apr;82(4):e38-e46 [FREE Full text] [CrossRef] [Medline]
    34. Muessig KE, Pike EC, Legrand S, Hightow-Weidman LB. Mobile phone applications for the care and prevention of HIV and other sexually transmitted diseases: a review. J Med Internet Res 2013;15(1):e1 [FREE Full text] [CrossRef] [Medline]
    35. Cell phones approach total penetration globally with smartphones moving toward market dominance. 2011.   URL: http:/​/www.​prnewswire.com/​news-releases/​cell-phones-approach-total-penetration-globally-with-smartphones-moving-toward-market-dominance-133877063.​html [accessed 2014-02-17] [WebCite Cache]
    36. Li Q, Liu Y, Zhou Z, Li S, Luo F, Li D, et al. Online sex-seeking behaviors among men who have sex with men: implications for investigation and intervention. AIDS Behav 2012 Aug;16(6):1690-1698. [CrossRef] [Medline]
    37. Zhang D, Bi P, Lv F, Zhang J, Hiller JE. Differences between Internet and community samples of MSM: implications for behavioral surveillance among MSM in China. AIDS Care 2008 Oct;20(9):1128-1137. [CrossRef] [Medline]
    38. Nehl EJ, He N, Wang X, Lin L, Wong FY, Yu F. Feasibility and willingness of using e-technologies for HIV prevention and research targeting Chinese MSM. AIDS Care 2013;25(7):926-930 [FREE Full text] [CrossRef] [Medline]
    39. Tucker JD, Chen XS, Peeling RW. Syphilis and social upheaval in China. N Engl J Med 2010 May 6;362(18):1658-1661. [CrossRef] [Medline]
    40. Chen ZQ, Zhang GC, Gong XD, Lin C, Gao X, Liang GJ, et al. Syphilis in China: results of a national surveillance programme. Lancet 2007 Jan 13;369(9556):132-138. [CrossRef] [Medline]
    41. Chen XS, Peeling RW, Yin YP, Mabey DC. The epidemic of sexually transmitted infections in China: implications for control and future perspectives. BMC Med 2011;9:111 [FREE Full text] [CrossRef] [Medline]
    42. Zhao J, Cai WD, Gan YX, Zhang Y, Yang ZR, Cheng JQ, et al. A comparison of HIV infection and related risk factors between money boys and noncommercial men who have sex with men in Shenzhen, China. Sex Transm Dis 2012 Dec;39(12):942-948. [CrossRef] [Medline]
    43. Zhong F, Lin P, Xu H, Wang Y, Wang M, He Q, et al. Possible increase in HIV and syphilis prevalence among men who have sex with men in Guangzhou, China: results from a respondent-driven sampling survey. AIDS Behav 2011 Jul;15(5):1058-1066. [CrossRef] [Medline]
    44. Patton MQ. Qualitative Evaluation & Research Methods: Integrating Theory and Practice Fourth Edition. Newbury Park, CA: Sage Publications; 2015.
    45. Zhang N, Parish WL, Huang Y, Pan S. Sexual infidelity in China: prevalence and gender-specific correlates. Arch Sex Behav 2012 Aug;41(4):861-873. [CrossRef] [Medline]
    46. Pan S, Parish WL, Huang Y. Clients of female sex workers: a population-based survey of China. J Infect Dis 2011 Dec 1;204 Suppl 5:S1211-S1217 [FREE Full text] [CrossRef] [Medline]
    47. Huang L, Nehl EJ, Lin L, Meng G, Liu Q, Ross MW, et al. Sociodemographic and sexual behavior characteristics of an online MSM sample in Guangdong, China. AIDS Care 2014;26(5):648-652 [FREE Full text] [CrossRef] [Medline]
    48. Huang ZJ, He N, Nehl EJ, Zheng T, Smith BD, Zhang J, et al. Social network and other correlates of HIV testing: findings from male sex workers and other MSM in Shanghai, China. AIDS Behav 2012 May;16(4):858-871. [CrossRef] [Medline]
    49. Tian L, Tang S, Cao W, Zhang K, Li V, Detels R. Evaluation of a web-based intervention for improving HIV/AIDS knowledge in rural Yunnan, China. AIDS 2007 Dec;21 Suppl 8:S137-S142. [CrossRef] [Medline]
    50. Lou CH, Zhao Q, Gao ES, Shah IH. Can the Internet be used effectively to provide sex education to young people in China? J Adolesc Health 2006 Nov;39(5):720-728. [CrossRef] [Medline]
    51. Aran I. New gay dating app in China is getting all kinds of action. 2013 Dec 5. Jezebel   URL: http://jezebel.com/new-gay-dating-app-in-china-is-getting-all-kinds-of-act-1477168920 [accessed 2014-12-20] [WebCite Cache]
    52. Avery M, Meng G, Mills S. Two internet-based approaches to promoting HIV counselling and testing for MSM in China. Digital Culture & Education 2014;6:216-229 [FREE Full text]
    53. Lau JTF, Lau M, Cheung A, Tsui HY. A randomized controlled study to evaluate the efficacy of an Internet-based intervention in reducing HIV risk behaviors among men who have sex with men in Hong Kong. AIDS Care 2008 Aug;20(7):820-828. [CrossRef] [Medline]
    54. Zou H, Wu Z, Yu J, Li M, Ablimit M, Li F, et al. Internet-facilitated, voluntary counseling and testing (VCT) clinic-based HIV testing among men who have sex with men in China. PLoS One 2013;8(2):e51919 [FREE Full text] [CrossRef] [Medline]
    55. Zhang D, Bi P, Lv F, Tang H, Zhang J, Hiller JE. Internet use and risk behaviours: an online survey of visitors to three gay websites in China. Sex Transm Infect 2007 Dec;83(7):571-576 [FREE Full text] [CrossRef] [Medline]
    56. Zou H, Wu Z, Yu J, Li M, Ablimit M, Li F, et al. Sexual risk behaviors and HIV infection among men who have sex with men who use the internet in Beijing and Urumqi, China. J Acquir Immune Defic Syndr 2010 Feb;53 Suppl 1:S81-S87 [FREE Full text] [CrossRef] [Medline]
    57. Tsui HY, Lau JTF. Comparison of risk behaviors and socio-cultural profile of men who have sex with men survey respondents recruited via venues and the internet. BMC Public Health 2010;10:232 [FREE Full text] [CrossRef] [Medline]
    58. Lee SS, Tam DKP, Mak DWL, Wong KH. Use of the Internet for sex partnership in men who have sex with men before HIV infection. Public Health 2011 Jul;125(7):433-435. [CrossRef] [Medline]
    59. Guo Y, Li X, Fang X, Lin X, Song Y, Jiang S, et al. A comparison of four sampling methods among men having sex with men in China: implications for HIV/STD surveillance and prevention. AIDS Care 2011 Nov;23(11):1400-1409 [FREE Full text] [CrossRef] [Medline]
    60. Lu H, Liu Y, Dahiya K, Qian HZ, Fan W, Zhang L, et al. Effectiveness of HIV risk reduction interventions among men who have sex with men in China: a systematic review and meta-analysis. PLoS One 2013;8(8):e72747 [FREE Full text] [CrossRef] [Medline]
    61. Nachega JB, Uthman OA, del RC, Mugavero MJ, Rees H, Mills EJ. Addressing the Achilles' heel in the HIV care continuum for the success of a test-and-treat strategy to achieve an AIDS-free generation. Clin Infect Dis 2014 Jul;59 Suppl 1:S21-S27. [CrossRef] [Medline]
    62. Muessig KE, Nekkanti M, Bauermeister J, Bull S, Hightow-Weidman LB. A Systematic Review of Recent Smartphone, Internet and Web 2.0 Interventions to Address the HIV Continuum of Care. Curr HIV/AIDS Rep 2015 Mar;12(1):173-190. [CrossRef] [Medline]


    Abbreviations

    AIDS: acquired immune deficiency syndrome
    ART: antiretroviral therapy
    CD4: cluster of differentiation 4, glycoprotein found on the surface of immune cells
    CMCC: China Mobile Communications Corporation
    eHealth: electronic Health
    GPS: global positioning systems
    GZTZ: Guangzhou Tongzhi
    HIV: human immunodeficiency virus
    MSM: men who have sex with men
    QQ: Tencent QQ, a popular instant messaging software service in China
    SMS: short message service/text messaging
    STD: sexually transmitted disease
    STI: sexually transmitted infection


    Edited by G Eysenbach; submitted 12.03.14; peer-reviewed by D Zhang, B Sheoran, M Gilbert, Q Li, M Dogan; comments to author 24.07.14; revised version received 19.12.14; accepted 05.02.15; published 21.04.15

    ©Kathryn E Muessig, Cedric H Bien, Chongyi Wei, Elaine J Lo, Min Yang, Joseph D Tucker, Ligang Yang, Gang Meng, Lisa B Hightow-Weidman. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 21.04.2015.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.