Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 01.08.19 in Vol 21, No 8 (2019): August

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/14145, first published Mar 27, 2019.

This paper is in the following e-collection/theme issue:

    Original Paper

    An Internet-Based HIV Self-Testing Program to Increase HIV Testing Uptake Among Men Who Have Sex With Men in Brazil: Descriptive Cross-Sectional Analysis

    1Instituto Nacional de Infectologia Evandro Chagas, Oswaldo Cruz Foundation, Rio de Janeiro, Brazil

    2National Department of STI, AIDS, and Viral Hepatitis, Ministry of Health, Brailia, Brazil

    3Escola Nacional de Saúde Pública, Oswaldo Cruz Foundation, Rio de Janeiro, Brazil

    4Secretaria Municipal de Saúde Curitiba, Curitiba, Brazil

    5Grupo Dignidade, Curitiba, Brazil

    6Centers for Disease Control and Prevention-Brazil, Brasilia, Brazil

    7Division of Global HIV & TB, Center for Global Health, Centers for Disease Control and Prevention, Atlanta, GA, United States

    8HIV Department, World Health Organization, Geneva, Switzerland

    Corresponding Author:

    Raquel Brandini De Boni, MD, MSc, PhD

    Instituto Nacional de Infectologia Evandro Chagas

    Oswaldo Cruz Foundation

    Av Brasil 4365

    Rio de Janeiro, 20530-360

    Brazil

    Phone: 55 21 3865 9122

    Email: raqueldeboni@gmail.com


    ABSTRACT

    Background: Approximately 30% of people living with HIV worldwide are estimated to be unaware of their infection. HIV self-testing (HIVST) is a strategy recommended by the World Health Organization to increase access to and uptake of testing among key populations who are at high risk for HIV infection.

    Objective: This study aimed to describe the development and feasibility of a free, anonymous, internet-based HIVST strategy designed for men who have sex with men in Curitiba, Brazil (electronic testing [e-testing]).

    Methods: The project was developed under the scope of the “A Hora é Agora” (The Time is Now) program. Individuals aiming to request an HIVST package (two tests each) answered an anonymous 5-minute questionnaire regarding inclusion criteria and sexual risk behavior. Eligible individuals could receive one package every 6 months for free. Website analytics, response to online questionnaires, package distribution, and return of test results were monitored via a platform-integrated system.

    Results: Between February 2015 and January 2016, the website documented 17,786 unique visitors and 3218 completed online questionnaires. Most individuals self-reported being white (77.0%), young (median age: 25 years, interquartile range: 22-31 years), educated (87.3% completed secondary education or more), and previously tested for HIV (62.5%). Overall, 2526 HIVST packages were delivered; of those, 542 (21.4%) reported a result online or by mail (23 reactive and 11 invalid). During the study period, 37 individuals who reported using e-testing visited the prespecified health facility for confirmatory testing (30 positive, 7 negative).

    Conclusions: E-testing proved highly feasible and acceptable in this study, thus supporting scale-up to additional centers for men who have sex with men in Brazil.

    J Med Internet Res 2019;21(8):e14145

    doi:10.2196/14145

    KEYWORDS



    Introduction

    In 2016, it was estimated that 30% of people living with HIV worldwide were unaware of their infection [1]. This gap represents a major challenge to achieving the targets of the Joint United Nations Programme on HIV/AIDS (UNAIDS) “90-90-90,” which aims to ensure that 90% of all people living with HIV are aware of their status by 2020 [2].

    Unknown HIV status is associated with late entry into care and increased mortality rates and is a key driver of the epidemic [3-5]. An HIV test result is the first step in engaging in the HIV treatment continuum for those who test positive or in the HIV prevention continuum for those who test negative. Nonetheless, many barriers to expand HIV testing coverage persist, such as stigma, difficulty in accessing testing facilities, and inconvenient clinic hours [6,7].

    HIV self-testing (HIVST) allows individuals to perform an HIV test and interpret their own results [8]. Different strategies for HIVST distribution worldwide have been proposed, such as through peers [9], nongovernment organizations (NGOs) [10], and mobile/social media apps [11]. Randomized controlled trials have shown that HIVST increases uptake and frequency of HIV testing overall, without adverse events, social harm, or increased risk behaviors [12]. Nevertheless, a review of HIVST implementation studies by Estem et al [13] concluded that despite the many potential benefits of HIVST, dissemination strategies need to be improved and the high cost of HIVST kits needs to be reduced to scale-up this strategy.

    Key populations, including gay and other men who have sex with men (MSM), are greatly affected by HIV in Latin America and other regions [14,15]. Such populations have continued high HIV incidence and encounter multiple structural barriers, including stigma and discrimination, which increase their risk of HIV exposure and acquisition and inhibit access to evidence-based HIV prevention and treatment services [16]. In Brazil, the prevalence of HIV among MSM, estimated at 14% in 2009 [17] and 17.5% in 2016 [18], requires sustained prevention and treatment efforts. Furthermore, despite an increased proportion of MSM reporting annual testing (from 21.2% in 2009 to 43.3% in 2016) [19], innovations are needed to increase MSM testing coverage in the country. The convenience and discreet approach of self-testing would be particularly useful to increase first-time HIV testing and frequency among this vulnerable population.

    Internet-based and mobile phone technologies are promising tools to overcome HIVST delivery barriers among MSM [20]. In the United Kingdom and United States, both online and social media–based promotion and delivery of free HIVST kits effectively increased the frequency of testing and reached MSM who were not previously tested [21,22]. In accordance with international data [23,24], a previous Brazilian study suggested that HIVST would be well accepted among MSM [25]. Thus, providing HIVST using these technologies may represent a step forward in increasing testing access in Brazil, where free HIV testing is already provided by the Brazilian Public Health System (“Sistema Unico de Saúde”).

    Considering the limited access to and uptake of HIV testing among MSM in Brazil and the evidence supporting its acceptability, this paper reports on the development and feasibility of an internet-based HIVST (electronic testing [e-testing]) approach. E-testing was designed to promote HIV prevention by providing free anonymous HIVST and to enhance linkage to HIV care for those with a confirmed HIV positive status. We describe the results from the e-testing program’s first year, when HIVST was not available in Brazil outside the research studies.


    Methods

    Design

    This cross-sectional analysis describes the results obtained from the e-testing strategy between February 2015 and January 2016.

    E-testing was developed as part of the broader initiative “A Hora é Agora” (AHA; or “The Time is Now”), which included three community-based strategies to deliver rapid HIV testing: a mobile testing unit, an NGO site, and e-testing. AHA was implemented in partnership with the Oswaldo Cruz Foundation (FIOCRUZ); the Department of STI, AIDS, and Viral Hepatitis of the Brazilian Ministry of Health; the Municipal Health Secretariat of Curitiba; the Federal University of Paraná; Grupo Dignidade (a local Lesbian Gay Bisexual Transgender and Queer/Questioning NGO); and Centers for Disease Control and Prevention (CDC) - Brazil. Implementation of the AHA program was focused in Curitiba, a city with 1.75 million inhabitants in southern Brazil and an estimated HIV prevalence of 19.9% (95% CI 14.2-27.2) among MSM [18].

    Recruitment

    The AHA program counted on an extensive communications plan to increase HIV testing and target young MSM [26]. The appropriateness of the communications strategy was piloted in focus groups including the target population, conducted in the preformative research (which also mapped the main MSM gathering sites and possible community partners to the program). The communication plan was continuously monitored and evaluated during the entire program via independent focus groups conducted in 2016 and Google Analytics.

    Briefly, the communications included printed handouts distributed via in-person outreach events in places where MSM socialize in the city; partnerships with gay and MSM-friendly establishments such as saunas, movie theatres, cafes, and bars; and virtual messages disseminated trough a Facebook page and gay online sites such as ManHunt and Grindr. Examples of the materials used for AHA are presented in Figure 1.

    Figure 1. Sample of the “A Hora é Agora” communications strategy for Curitiba, Brazil (2015-2016).
    View this figure

    Study Population

    Participants were eligible to receive an HIVST package if they were male at birth, were at least 18 years of age, resided in Curitiba, were HIV-negative or had an unknown HIV status, had access to the internet, and agreed to participate in the study after reading the online informed consent form.

    E-Testing Web Platform

    The internet platform was made available to all at www.ahoraeagora.org and could be accessed via personal computer, smartphones, or tablets (apps were available for IOS and Android). This platform contained four modules (ie, website sections presenting different access credentials): general information, HIVST order, management, and monitoring. The general information module contained HIV prevention information targeted to MSM, a step-by-step video, written instructions for using HIVST, geocoded options for HIV testing locations in Curitiba, and a personal risk assessment calculator (Figure 2).

    The risk assessment calculator was adapted from the HIV incidence risk for MSM scale, a 7-item questionnaire developed to predict HIV seroconversion among MSM [27] and recommended by the CDC to screen individuals for eligibility for pre-exposure prophylaxis [28]. Individuals could check their risk status and receive feedback, but data were not collected/saved in the platform. (Figure 3).

    The HIVST order module included an online questionnaire and the option to request HIVST. This module evaluated eligibility criteria and enabled test kit delivery via standard Brazilian mail or self-pick up at a central pharmacy within 2 weeks. After completing the mandatory section of the questionnaire and selecting a delivery option, a random personal identification number (PIN) was assigned by the automated system. The PIN was used to track future HIVST requests, collect self-reported HIVST results, and monitor subsequent linkage to further testing and HIV care.

    The management module encompassed the administration and logistics functions of HIVST package delivery (including central and pharmacy inventory control) and generated management reports for authorized staff. Finally, the fourth module monitored access and usability statistics of the AHA website (using Google Analytics), aggregated data from the order module, and generated routine reports.

    Figure 2. E-testing Web platform: general information module.
    View this figure
    Figure 3. E-testing Web platform: risk assessment calculator.
    View this figure

    HIV Self-Testing Package

    MSM who met the eligibility criteria and accessed the e-testing website could order an HIVST package. The package included two OraQuick Advanced HIV-1/2 HIVST kits, (OraSure Technologies, Inc, Bethlehem, PA, adapted and repackaged for self-testing in Brazil), condoms, lubricants, written self-test instruction, an anonymous prepaid card for returning test results (for those preferring to return the results by mail), and information about health facilities that provided free confirmatory HIV testing. Between March 7, 2015, and May 4, 2015, and between August 14, 2015, and February 29, 2016, only one HIVST was sent in each package. Using their PIN, individuals could order a new package every 6 months.

    Measures

    Website Analytics, HIV Self-Testing Distribution, and Platform Usability

    Website analytics were measured using Google Analytics. Data on HIVST distribution were retrieved from the management module. Platform usability was measured using the following questions:

    • Question: “Overall, did you find this platform easy to use?” Response: Yes/No
    • Question: “What were the major difficulties you find in the platform?” Responses: “I was not able to find the links I was looking for” / “I would like to have access to more tests” / “I would like to retrieve the tests in other places” / “I did not find any difficulties” / “Other-specify”
    • Question: “Did you find the testing instructions clear?” Response: Yes/No.
    Characteristics of the Study Population

    Individuals requesting an HIVST package were encouraged to answer the online questionnaire available in the HIVST order module. The questionnaire comprised two parts: the first was mandatory to initiate the HIVST request and included the eligibility criteria (eg, participant’s age, city, and unknown or negative HIV status). The second part was optional and evaluated demographic characteristics (eg, schooling, color/race, gender and sexual orientation, and steady partner), risk perception (using the question “What is your likelihood of getting HIV in the next 12 months?”) [29], and risk behavior for HIV infection (using the HIV incidence risk for the MSM scale) [27].

    HIV Self-Testing Result Return

    Individuals were asked to return their results either by directly entering result information into the website (using their PINs) or via the prepaid postal card. Additionally, when uploading results to the website, individuals were invited to answer a questionnaire regarding their experience and any possible social harm (using three dichotomous questions regarding coercion, feelings of shame, or violent reactions of partners).

    Confirmatory Testing

    Individuals with a reactive or invalid test result were instructed to seek confirmatory testing at Curitiba’s reference center for HIV Counseling and Testing (COA) and to bring their PIN. The COA follows the HIV testing algorithm of the 2014 Brazilian Ministry of Health guidelines [30], and those confirmed to be HIV-positive were offered immediate HIV care. A question regarding the AHA testing strategies was included in the regular COA form, and staff reported the number of tests performed as a result of referrals from specific AHA project strategies.

    Feasibility Outcomes

    Project success was defined a priori as ≥60% individuals ordering HIVST after starting the online request process; ≥50% individuals picking up the HIVST at the pharmacy within 2 weeks; 1000 HIVST packages (2000 HIVST kits) distributed in 12 months; 20% HIVST results returned via mail or the online platform; and ≥50% individuals, who self-reported a reactive HIVST, accessing the COA for confirmatory testing and HIV care. There were no a priori outcomes related to the second HIVST kit included in the package.

    Although there was scarce evidence to determine all the feasibility outcomes at the time of the study design (2014), a limited-advertised Brazilian Web survey was able to reach 629 MSM in around 10 days, of whom 82 were from the South region of the country. The vast majority (89.8%) of them reported high interest in using HIVST [25]. As the South of the country has three state capitals, and this project had a strong communications plan, we expected to distribute around 80 HIVST per month (rounded to 1000/year) in the selected South Capital (Curitiba). For the outcomes that we had no previous data on, we considered the most conservative estimate (50%) to be acceptable. Finally, regarding return of the testing results, we considered the general low response of mail and email surveys conducted in different areas of knowledge [31-34] and the additional absence of incentives; as such, we expected that 20% of the results would be returned to the project.

    Statistical Analysis

    We present the results of the online questionnaires and HIVST results returned using descriptive statistics, including both absolute counts and relative frequencies and 95% CIs. Data were analyzed using SPSS software (IBM Corp, Armonk, NY).

    Ethical Issues

    Details of informed consent were displayed in pop-up windows preceding the online questionnaire. No personally identifying information was collected in the informed consent forms or questionnaires to preserve users’ anonymity.

    Personal information necessary for HIVST delivery was saved in the Web server and was restricted to trained staff in charge of package mail delivery. All staff members signed a confidentiality agreement. Identification for HIVST delivery was not linked to individuals’ questionnaire responses. To ensure information security and confidentiality, the website used verified access to the original site, data encryption between personal computers and the website, and encryption of database tables. Information was only available to users registered with a login and a safe password.

    Trained counselors at a 24/7 hotline were available to assist in the event of any psychological crisis. Social harm, such as coercion or violent reactions of partners, was considered an adverse event and was assessed in the feedback questionnaire.

    The e-testing study protocol was approved by the Evandro Chagas National Institute of Infectious Diseases/FIOCRUZ Institutional Review Board (CAAE number: 37848114.9.0000.5262). The study was reviewed according to the Centers for Disease Control and Prevention human research protection procedures and was determined to be research but the CDC was not engaged.


    Results

    The detailed frequencies and data sources of the e-testing study during its first year of implementation are provided in Figure 4.

    Figure 4. E-testing project flowchart for Curitiba, Brazil (2015-2016). *Between March 7, 2015, and May 4, 2015, and between August 14, 2015, and February 29, 2016, only one HIVST was sent in each package; therefore, the total number of unique HIVST kits distributed is 4342. HIVST: HIV self-testing.
    View this figure

    Website Analytics, HIV Self-Testing Distribution, and Platform Usability

    During the study period, the AHA website had 67,225 page views from 17,786 unique visitors. The most frequently viewed pages were those in which users could order an HIVST package by mail (9.7%), all pages containing information on HIV prevention (6.6%), and the page on risk self-assessment (6.5%; Table 1). The e-testing app had 2571 downloads (1780 downloads at Google Play and 791 at Apple Store).

    Overall, 3885 questionnaire respondents initiated an HIVST request, of which 2526 packages were delivered (215 requests were returned by mail, 124 were cancelled by the users, 884 were not picked up at the pharmacy within 2 weeks, 128 were not sent due to incomplete addresses, and 8 were in the process of delivery at the time the present dataset was closed; Figure 4). Most deliveries were made by the Brazilian mail (n=1943, 77%), and 583 (23%) packages were picked up at the pharmacy. A total of 66 PINs (of 3885, 1.7%) requested at least one additional HIVST package during the study period.

    Of all individuals accessing the website, 362 answered questions about the usability of the website. Most respondents found the site “Very easy” (n=260, 71.8%) or “Easy” (n=71, 19.6%) to use. Furthermore, 72% (262/362) stated that they did not have difficulties navigating the website, and only 21 (5.8%) stated that they did not find the pages they were searching for. The vast majority (n=339, 93.6%) also found that the website’s instructions for performing HIVST were clear.

    Table 1. Pages viewed (n=67,225) on the A Hora é Agora e-testing website in Curitiba, Brazil (February 6, 2015, to January 31, 2016).
    View this table

    Characteristics of the Study Population

    During the study period, 65% (4800/7300) of individuals who initiated an HIVST request met the eligibility criteria. Of the men who completed the online questionnaire (n=3218), most were young (median: 25 years; interquartile range [IQR]: 22-31 years), were of white race/ethnicity (n=2478, 77%), had completed at least secondary school (n=2810, 87%), and had never had an HIV test (n=1206, 37.5%; Table 2). The frequency of possible reasons for never testing were “I am afraid of having a positive result” (27.6%), “I feel ashamed” (21.7%), “It is inconvenient to go to a health care clinic” (15.7%), “I am not at risk of being infected” (10.4%), and “I feel lazy” (7.4%); 17.3% did not want to answer this question.

    Table 2. Demographic and behavioral characteristics of men who completed the online questionnaire at the A Hora é Agora e-testing website in Curitiba, Brazil 2015-2016 (N=3218).
    View this table

    Return of HIV Self-Testing Results

    Of the 2526 packages delivered, 21.4% (n=542) returned an HIVST result on the website or by mail. Of these, 19 reactive and 11 invalid test results were entered into the website platform and 4 reactive results were returned by mail (as of February 29, 2016).

    There were 91 responses to the feedback survey on self-testing, but we received no reports (questionnaire or hotline) of psychological crises or violent reactions from partners. However, one individual reported feeling ashamed because someone saw him self-testing.

    Confirmatory Testing

    As of February 2016, 37 individuals were tested at the COA reporting to have used the e-testing: 30 had HIV-positive results and 7 had negative results.

    Feasibility Outcomes

    Project success was achieved for most of the previously defined outcomes (Table 3).

    Over the study period, the telephone hotline received 70 calls: two were questions regarding what to do following a reactive result, three were related to assistance with interpreting the self-test result, five were related to queries on test performance, six were related to problems with HIVST delivery, and the remaining were about HIV testing in general and not about self-testing/e-testing.

    Table 3. Feasibility outcomes defined in the study protocol and achievements in the A Hora é Agora e-testing project in Curitiba, Brazil (2015-2016).
    View this table

    Discussion

    We describe an internet-based strategy to provide HIV prevention information and HIVST to MSM in Curitiba, Brazil. In the first year, we delivered 2526 HIVST packages, substantially more than predicted in the study design (1000 packages). Our findings are similar to reports from previous studies that have shown good uptake and use of websites containing information on HIV prevention, self-assessment of risk, and HIVST among MSM [35,36]. Such high uptake is likely due to the significant number of MSM who use social media and the internet to look for sexual partners [37]. A previous Web-based survey in 10 Brazilian cities [38] found that 1798 (35.6%) and 678 (13.4%) of responding MSM reported daily and weekend use of websites and smart phone apps to seek sexual partners.

    The use of internet and social media approaches for health promotion and behavioral interventions has become more routine according to international literature and already includes smoking cessation [39] and heart disease prevention programs [40]. The internet and social media are particularly promising ways to offer testing to MSM at high ongoing risk of HIV [41], as those using social media and the internet to meet sexual partners also have high-risk behavior and increased HIV risk [42,43]. Thus, internet-based health initiatives can help overcome health disparities to access prevention and care, particularly among MSM, and can help facilitate uptake of HIV testing, prevention, and treatment services.

    E-testing appeared to appeal to never-tested MSM who reported a fear of having a positive result, shame (which is probably related to stigma), and unfriendly health facilities. These results are consistent with reports showing that HIVST is highly acceptable to MSM [25,44] and can facilitate uptake and frequency of testing. This demand was likely driven by the privacy of e-testing, which systematic reviews have highlighted as a priority for MSM [23]. Similarly, the large number of HIVST packages delivered by mail, compared to packages retrieved in the public pharmacy, was likely related to introducing delivery models that addressed challenges such as travel distances, wait times at facilities, and confidentiality issues [45,46], all of which have been previously cited as barriers to testing.

    Of the individuals who answered the entire online questionnaire, most identified as young, white, well-educated, and without a steady partner. Although these characteristics were similar to those reported in other studies among MSM in the country [38,47], there were some differences as compared to a recent household probability survey conducted among men from Curitiba [48]: In our study, participants were younger, more likely to be white (77% vs 64%), less likely to perceive high risk for HIV infection (8% vs 52%), and less likely to have ever had an HIV test (62.5% vs 75.7%) than found in the survey [48].

    However, the latest Brazilian estimates have shown an increase in the HIV prevalence among young MSM [18], who also showed riskier sexual behavior than older MSM [19]. This new evidence reinforces the importance of strategies to successfully reach this key population. Our findings suggest that, at least for young MSM, important subpopulations are open to new HIV testing strategies and understand the need for frequent or risk-based HIV testing.

    In our study, HIVST was provided for free but without the provision of any incentives (the Brazilian Ethic regulations do not allow the provision of incentives for research participants or patients). We received 21.4% of HIVST results (18.2% through the website and 3.2% by mail). This was a substantially lower proportion than presented in China by Zhong et al [49], who reported 97% of self-testers returning results when HIVST kit costs were refunded upon return of results. We believe that this difference is related to the provision of incentives, and not providing incentives was one of the reasons why we estimated a low return rate when designing this feasibility study. However, the World Health Organization recommends self-testing as an additional HIV testing tool [8], not as an HIV surveillance tool, meaning that a low return rate may not represent a major drawback. On the other hand, confirmatory testing and rapid linkage to care are essential after a reactive HIVST result. A study conducted in Brazil reported that of 131 MSM who tested positive, only 95 (72.5%) were linked to care [50]. Because of the anonymity of the e-testing strategy, the proportion of study participants who sought confirmatory testing is uncertain. Furthermore, although users were instructed to bring their PIN to the COA when seeking confirmatory testing, no one accessing services at COA provided a PIN. Therefore, we could not match the HIVST results and confirmatory results. Other programs seeking ways to track users’ confirmatory testing and linkage to HIV services following HIVST should be aware of this limitation and the challenges with monitoring HIVST implementation. Other potential caveats of self-testing discussed in the literature are psychological crises and social harm. In our study, neither of these events were reported, which is consistent with the international literature [12,23].

    E-testing was largely successful during its first year: E-testing achieved most of the previously defined study outcomes, and demand for HIVST was twice that initially anticipated. However, our study had limitations. The anonymous, self-reported nature of data collection and the low proportion of users who reported their HIVST results prevented us from validating individual HIVST results with confirmatory tests and from estimating the HIV prevalence (due to the inability to exclude multiple answers from the same individuals). Additionally, because we did not track the second test distributed in the package, it is possible that the test requestor gave the second test to a friend or partner, which would increase the number of individuals tested during the study period. We likely also missed MSM who may be fearful of HIV testing and those who did not have access to the internet, which limits the generalizability of our findings. Despite these limitations, we achieved our primary goal, which was to reach individuals who do not access traditional HIV testing services.

    In conclusion, our findings show that an internet-based strategy to provide free, anonymous HIVST kits was acceptable and feasible in Brazil. Lessons learned from this study may also be applied to other countries in Latin America with similar cultural and epidemiological contexts. The discretion and convenience of HIVST may increase testing among MSM who are not reached through existing services. Future investigation is needed, however, to identify strategies to support linkage to prevention and treatment services and to determine the potential public health impact and cost-effectiveness of HIVST in Brazil.

    Acknowledgments

    This project was supported (in part) by the President’s Emergency Plan for AIDS Relief (PEPFAR) through the CDC under the terms of the Key Population Implementation Science (KPIS) initiative (Grant number: NU2GGH01152). The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the funding agencies.

    Conflicts of Interest

    None declared.

    References

    1. UNAIDS. Geneva: Joint United Nations Programme on HIV/AIDS (UNAIDS); 2017. Ending AIDS: Progress towards the 90-90-90 targets   URL: http://www.unaids.org/sites/default/files/media_asset/Global_AIDS_update_2017_en.pdf [accessed 2018-04-18]
    2. UNAIDS. Geneva: Joint United Nations Programme on HIV/AIDS (UNAIDS); 2014. 90-90-90 An ambitious treatment target to help end the AIDS epidemic   URL: https://www.unaids.org/sites/default/files/media_asset/90-90-90_en.pdf [accessed 2018-04-24]
    3. Mocroft A, Lundgren JD, Sabin ML, Monforte AD, Brockmeyer N, Casabona J, Collaboration of Observational HIV Epidemiological Research Europe (COHERE) study in EuroCoord. Risk factors and outcomes for late presentation for HIV-positive persons in Europe: results from the Collaboration of Observational HIV Epidemiological Research Europe Study (COHERE). PLoS Med 2013;10(9):e1001510 [FREE Full text] [CrossRef] [Medline]
    4. Fisher M, Pao D, Brown A, Sudarshi D, Gill O, Cane P, et al. Determinants of HIV-1 transmission in men who have sex with men: a combined clinical, epidemiological and phylogenetic approach. AIDS 2010 Jul 17;24(11):1739-1747. [CrossRef] [Medline]
    5. Rutstein S, Ananworanich J, Fidler S, Johnson C, Sanders E, Sued O, et al. Clinical and public health implications of acute and early HIV detection and treatment: a scoping review. J Int AIDS Soc 2017 Dec 28;20(1):21579 [FREE Full text] [CrossRef] [Medline]
    6. Golub S, Gamarel K. The impact of anticipated HIV stigma on delays in HIV testing behaviors: findings from a community-based sample of men who have sex with men and transgender women in New York City. AIDS Patient Care STDS 2013 Nov;27(11):621-627 [FREE Full text] [CrossRef] [Medline]
    7. Meyerson B, Barnes P, Emetu R, Bailey M, Ohmit A, Gillespie A. Institutional and structural barriers to HIV testing: elements for a theoretical framework. AIDS Patient Care STDS 2014 Jan;28(1):22-27. [CrossRef] [Medline]
    8. World Health Organization. 2016. Guidelines on HIV self-testing and partner notification   URL: https:/​/apps.​who.int/​iris/​bitstream/​handle/​10665/​251655/​9789241549868-eng.​pdf;jsessionid=375E7E7B8BC009D0836193B4E5961AAF?sequence=1 [accessed 2018-04-24]
    9. Lippman S, Lane T, Rabede O, Gilmore H, Chen Y, Mlotshwa N, et al. High Acceptability and Increased HIV-Testing Frequency After Introduction of HIV Self-Testing and Network Distribution Among South African MSM. J Acquir Immune Defic Syndr 2018 Dec 01;77(3):279-287 [FREE Full text] [CrossRef] [Medline]
    10. Carey J. HIV self-testing: feasibilityacceptability of a large scale national service delivery by a community organization. 2017 Presented at: 9th International AIDS Society; 2017; Paris   URL: https://www.iasociety.org/Web/WebContent/File/IAS2017_conference_report.pdf
    11. Rosengren A, Huang E, Daniels J, Young S, Marlin R, Klausner J. Feasibility of using Grindr to distribute HIV self-test kits to men who have sex with men in Los Angeles, California. Sex Health 2016 May 23:na (forthcoming). [CrossRef] [Medline]
    12. Johnson C, Kennedy C, Fonner V, Siegfried N, Figueroa C, Dalal S, et al. Examining the effects of HIV self-testing compared to standard HIV testing services: a systematic review and meta-analysis. J Int AIDS Soc 2017 Dec 15;20(1):21594 [FREE Full text] [CrossRef] [Medline]
    13. Estem K, Catania J, Klausner J. HIV Self-Testing: a Review of Current Implementation and Fidelity. Curr HIV/AIDS Rep 2016 Apr;13(2):107-115. [CrossRef] [Medline]
    14. De Boni R, Veloso V, Grinsztejn B. Epidemiology of HIV in Latin America and the Caribbean. Curr Opin HIV AIDS 2014 Mar;9(2):192-198. [CrossRef] [Medline]
    15. Ackers M, Greenberg A, Lin C, Bartholow B, Goodman A, Longhi M, et al. High and persistent HIV seroincidence in men who have sex with men across 47 U.S. cities. PLoS One 2012;7(4):e34972 [FREE Full text] [CrossRef] [Medline]
    16. Beyrer C, Baral S, van Griensven F, Goodreau S, Chariyalertsak S, Wirtz A, et al. Global epidemiology of HIV infection in men who have sex with men. Lancet 2012 Jul 28;380(9839):367-377 [FREE Full text] [CrossRef] [Medline]
    17. Kerr L, Mota R, Kendall C, Pinho AA, Mello M, Guimarães MDC, HIVMSM Surveillance Group. HIV among MSM in a large middle-income country. AIDS 2013 Jan 28;27(3):427-435. [CrossRef] [Medline]
    18. Kerr L, Kendall C, Guimarães MDC, Salani Mota R, Veras M, Dourado M, et al. HIV prevalence among men who have sex with men in Brazil: results of the 2nd national survey using respondent-driven sampling. Medicine (Baltimore) 2018 May;97(1S Suppl 1):S9-S15 [FREE Full text] [CrossRef] [Medline]
    19. Guimarães MDC, Kendall C, Magno L, Rocha G, Knauth D, Leal A, Brazilian HIV/MSM Surveillance Group. Comparing HIV risk-related behaviors between 2 RDS national samples of MSM in Brazil, 2009 and 2016. Medicine (Baltimore) 2018 May;97(1S Suppl 1):S62-S68 [FREE Full text] [CrossRef] [Medline]
    20. LeGrand S, Muessig K, Horvath K, Rosengren A, Hightow-Weidman L. Using technology to support HIV self-testing among MSM. Curr Opin HIV AIDS 2017 Sep;12(5):425-431 [FREE Full text] [CrossRef] [Medline]
    21. MacGowan R. The impact of HIV self-testing among internetrecruited MSM, eSTAMP. : IAS; 2017 Presented at: 9th International AIDS Society; 2017; Paris.
    22. James C. HIV self-testing: feasibilityacceptability of a large scale national service delivered by a community organization. : IAS; 2017 Presented at: 9th International AIDS Society; 2017; Paris.
    23. Figueroa C, Johnson C, Verster A, Baggaley R. Attitudes and Acceptability on HIV Self-testing Among Key Populations: A Literature Review. AIDS Behav 2015 Nov 9;19(11):1949-1965 [FREE Full text] [CrossRef] [Medline]
    24. Oldenburg C, Biello K, Perez-Brumer A, Rosenberger J, Novak D, Mayer K, et al. HIV testing practices and the potential role of HIV self-testing among men who have sex with men in Mexico. Int J STD AIDS 2017 Dec;28(3):242-249 [FREE Full text] [CrossRef] [Medline]
    25. Lippman S, Périssé ARS, Veloso V, Sullivan P, Buchbinder S, Sineath R, et al. Acceptability of self-conducted home-based HIV testing among men who have sex with men in Brazil: data from an on-line survey. Cad Saude Publica 2014 Apr;30(4):724-734 [FREE Full text] [Medline]
    26. De Boni RB, Lentini N, Santelli A, Barbosa JA, Cruz M, Bingham T, et al. Self-testing, communication and information technology to promote HIV diagnosis among young gay and other men who have sex with men (MSM) in Brazil. J Int AIDS Soc 2018 Jul;21 Suppl 5:e25116 [FREE Full text] [CrossRef] [Medline]
    27. Smith D, Pals S, Herbst J, Shinde S, Carey J. Development of a clinical screening index predictive of incident HIV infection among men who have sex with men in the United States. J Acquir Immune Defic Syndr 2012 Aug 01;60(4):421-427. [CrossRef] [Medline]
    28. Centers for Disease Control and Prevention. 2014. Preexposure Prophylaxis for the Prevention of HIV Infection in the United States? 2017 Update   URL: https://www.cdc.gov/hiv/pdf/risk/prep/cdc-hiv-prep-provider-supplement-2017.pdf [accessed 2018-04-24]
    29. Hoagland B, De Boni RB, Moreira R, Madruga J, Kallas E, Goulart S, PrEP Brasil Study Team. Awareness and Willingness to Use Pre-exposure Prophylaxis (PrEP) Among Men Who Have Sex with Men and Transgender Women in Brazil. AIDS Behav 2017 May;21(5):1278-1287. [CrossRef] [Medline]
    30. Manual técnico para o diagnóstico da infecção pelo HIV [in Spanish]. Brasilia: Ministério da Saúde; 2013:74.
    31. Carpe Carpe B, Hernando Arizaleta L, Monteagudo Piqueras O, Abellán Perpiñán JM, Palomar Rodríguez JA, Alonso J. Response bias in a population postal survey on Health-Related Quality of Life (sf-12v2) [in Spanish]. Rev Esp Salud Publica 2014;88(3):327-337 [FREE Full text] [CrossRef] [Medline]
    32. Krska J, du Plessis R, Chellaswamy H. Views and experiences of the NHS Health Check provided by general medical practices: cross-sectional survey in high-risk patients. J Public Health (Oxf) 2015 Jun;37(2):210-217. [CrossRef] [Medline]
    33. Nota S, Strooker J, Ring D. Differences in response rates between mail, e-mail, and telephone follow-up in hand surgery research. Hand (N Y) 2014 Dec;9(4):504-510 [FREE Full text] [CrossRef] [Medline]
    34. Yarris L, Fu R, Duby R, Frakes B, Brooks H, Norton R. Comparison of mailed vs. on-site emergency department patient satisfaction surveys. J Emerg Med 2014 Dec;47(6):702-709. [CrossRef] [Medline]
    35. Anand T, Nitpolprasert C, Ananworanich J, Pakam C, Nonenoy S, Jantarapakde J, et al. Innovative strategies using communications technologies to engage gay men and other men who have sex with men into early HIV testing and treatment in Thailand. J Virus Erad 2015 Apr 01;1(2):111-115 [FREE Full text] [Medline]
    36. Zou H, Wu Z, Yu J, Li M, Ablimit M, Li F, et al. Internet-facilitated, voluntary counseling and testing (VCT) clinic-based HIV testing among men who have sex with men in China. PLoS One 2013;8(2):e51919 [FREE Full text] [CrossRef] [Medline]
    37. Liau A, Millett G, Marks G. Meta-analytic examination of online sex-seeking and sexual risk behavior among men who have sex with men. Sex Transm Dis 2006 Sep;33(9):576-584. [CrossRef] [Medline]
    38. Torres T, De Boni RB, de Vasconcellos MT, Luz P, Hoagland B, Moreira R, et al. Awareness of Prevention Strategies and Willingness to Use Preexposure Prophylaxis in Brazilian Men Who Have Sex With Men Using Apps for Sexual Encounters: Online Cross-Sectional Study. JMIR Public Health Surveill 2018 Jan 22;4(1):e11 [FREE Full text] [CrossRef] [Medline]
    39. Bottorff J, Oliffe J, Sarbit G, Sharp P, Caperchione C, Currie L, et al. Evaluation of QuitNow Men: An Online, Men-Centered Smoking Cessation Intervention. J Med Internet Res 2016 Apr 20;18(4):e83 [FREE Full text] [CrossRef] [Medline]
    40. Devi R, Singh S, Powell J, Fulton E, Igbinedion E, Rees K. Internet-based interventions for the secondary prevention of coronary heart disease. Cochrane Database Syst Rev 2015 Dec 22(12):CD009386. [CrossRef] [Medline]
    41. Mustanski B, Lyons T, Garcia S. Internet use and sexual health of young men who have sex with men: a mixed-methods study. Arch Sex Behav 2011 Apr;40(2):289-300 [FREE Full text] [CrossRef] [Medline]
    42. Bull S, McFarlane M, Rietmeijer C. HIV and sexually transmitted infection risk behaviors among men seeking sex with men on-line. Am J Public Health 2001 Jun;91(6):988-989. [CrossRef] [Medline]
    43. Garofalo R, Herrick A, Mustanski B, Donenberg G. Tip of the Iceberg: young men who have sex with men, the Internet, and HIV risk. Am J Public Health 2007 Jun;97(6):1113-1117. [CrossRef] [Medline]
    44. Volk J, Lippman S, Grinsztejn B, Lama J, Fernandes N, Gonzales P, et al. Acceptability and feasibility of HIV self-testing among men who have sex with men in Peru and Brazil. Int J STD AIDS 2016 Dec;27(7):531-536 [FREE Full text] [CrossRef] [Medline]
    45. Gonçalves VF, Kerr L, Mota, Macena RHM, Almeida RLD, Freire DG, et al. Incentives and barriers to HIV testing in men who have sex with men in a metropolitan area in Brazil. Cad Saude Publica 2016 May 31;32(5)::e00049015 [FREE Full text] [CrossRef] [Medline]
    46. Sharma M, Ying R, Tarr G, Barnabas R. Systematic review and meta-analysis of community and facility-based HIV testing to address linkage to care gaps in sub-Saharan Africa. Nature 2015 Dec 03;528(7580):S77-S85 [FREE Full text] [CrossRef] [Medline]
    47. Grinsztejn B, Hoagland B, Moreira R, Kallas E, Madruga J, Goulart S, PrEP Brasil Study Team. Retention, engagement, and adherence to pre-exposure prophylaxis for men who have sex with men and transgender women in PrEP Brasil: 48 week results of a demonstration study. Lancet HIV 2018 Dec;5(3):e136-e145. [CrossRef] [Medline]
    48. Szwarcwald C, Damacena G, Miranda R, Pascom A, Júnior AB. HIV Testing among men in Curitiba, Brazil. AIDS Care 2018 Jan;30(1):56-58 [FREE Full text] [CrossRef] [Medline]
    49. Zhong F, Tang W, Cheng W, Lin P, Wu Q, Cai Y, et al. Acceptability and feasibility of a social entrepreneurship testing model to promote HIV self-testing and linkage to care among men who have sex with men. HIV Med 2017 Dec;18(5):376-382 [FREE Full text] [CrossRef] [Medline]
    50. Castro R, Ribeiro-Alves M, Corrêa RG, Derrico M, Lemos K, Grangeiro J, et al. The Men Who Have Sex with Men HIV Care Cascade in Rio de Janeiro, Brazil. PLoS One 2016;11(6):e0157309 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    AHA: “A Hora é Agora” (The Time is Now) program
    CDC: Centers for Disease Control and Prevention
    COA: HIV Counseling and Testing Center
    FIOCRUZ: Oswaldo Cruz Foundation
    HIVST: HIV self-testing
    IQR: interquartile range
    MSM: men who have sex with men
    NGO: nongovernmental organization
    PEPFAR: President’s Emergency Plan for AIDS Relief
    PIN: personal identification number
    STI: sexually transmitted infection
    UNAIDS: Joint United Nations Programme on HIV/AIDS
    WHO: World Health Organization


    Edited by G Eysenbach; submitted 27.03.19; peer-reviewed by K Wilson, J Opoku; comments to author 14.06.19; revised version received 25.06.19; accepted 27.06.19; published 01.08.19

    ©Raquel Brandini De Boni, Valdilea Gonçalves Veloso, Nilo Martinez Fernandes, Flavia Lessa, Renato Girade Corrêa, Renato De Souza Lima, Marly Cruz, Juliane Oliveira, Simone Muniz Nogueira, Beto de Jesus, Toni Reis, Nena Lentini, Raquel Lima Miranda, Trista Bingham, Cheryl C Johnson, Aristides Barbosa Junior, Beatriz Grinsztejn. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 01.08.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.