Published on 05.04.12 in Vol 14, No 2 (2012): Mar-Apr
Improving Adherence to Antiretroviral Therapy for Youth Living with HIV/AIDS: A Pilot Study Using Personalized, Interactive, Daily Text Message Reminders
Background: For youth living with human immunodeficiency virus (HIV)/acquired immunodeficiency syndrome (AIDS), nonadherence to antiretroviral therapy (ART) can lead to poor health outcomes and significantly decreased life expectancy.
Objective: To evaluate the feasability, acceptability, and preliminary efficacy of short message service (SMS) or text message reminders to improve adherence to ART for youth living with HIV/AIDS.
Methods: We conducted this prospective pilot study using a pre–post design from 2009 to 2010 at a community-based health center providing clinical services to youth living with HIV/AIDS. Eligibility criteria included HIV-positive serostatus, age 14–29 years, use of a personal cell phone, English-speaking, and being on ART with documented poor adherence. During the 24-week study period, participants received personalized daily SMS reminders and a follow-up message 1 hour later assessing whether they took the medication, and asking participants to respond via text message with the number 1 if they took the medication and 2 if they did not. Outcome measures were feasibility, acceptability, and adherence. Self-reported adherence was determined using the visual analog scale (VAS) and AIDS Clinical Trial Group (ACTG) questionnaire 4-day recall. Viral load and CD4 cell count were followed as biomarkers of adherence and disease progression at 0, 12, and 24 weeks.
Results: Participants (N = 25) were mean age 23 (range 14–29) years, 92% (n = 23) male, 60% (n = 15) black, and 84% (n = 21) infected through unprotected sex. Mean VAS scores significantly increased at 12 and 24 weeks in comparison with baseline (week 0: 74.7, week 12: 93.3, P < .001; week 24: 93.1, P < .001). ACTG questionnaire 4-day recall also improved (week 0: 2.33, week 12: 3.24, P = .002; week 24: 3.19, P = .005). There was no significant difference in CD4 cell count or viral load between baseline and 12- or 24-week follow-up, although there was a trend toward improvement of these biomarkers and a small to moderate standardized effect size (range of Cohen d: –0.51 to 0.22). Of 25 participants, 21 (84%) were retained, and 20 of the 21 (95%) participants who completed the study found the intervention helpful to avoid missing doses.
Conclusions: In this pilot study, personalized, interactive, daily SMS reminders were feasible and acceptable, and they significantly improved self-reported adherence. Larger controlled studies are needed to determine the impact of this intervention on ART adherence and other related health outcomes for youth living with HIV/AIDS.
J Med Internet Res 2012;14(2):e51
- text messaging;
- short message service;
- mobile health intervention
Over one million people in the United States are living with human immunodeficiency virus (HIV)/acquired immunodeficiency syndrome (AIDS). Youth aged 12–29 years account for more than a third of the approximately 50,000 new HIV infections each year [, ]. Nonadherence to antiretroviral therapy (ART) can lead to poor health outcomes and significantly decreased life expectancy, and it may increase the risk of secondary transmission and the development of resistant viral strains [ - ]. Challenges to adherence include pill burden, dosing schedule, food restrictions, and side effects [ - ]. However, forgetting is the most commonly cited reason for missing doses [ ]. A range of strategies to improve adherence to ART have been shown to be helpful for youth living with HIV/AIDS, including directly observed therapy, reminder devices, counseling, and telephone calls, but many of these strategies are expensive, time consuming, and potentially intrusive [ - ].
With over 230 million cell phones in use and 7 billion text messages sent every month in the United States, text messaging or short message service (SMS) has become a common mode of communication among youth, including those who are economically disadvantaged . This low-cost, convenient technology has provided benefit in a variety of health care settings and has been shown to be an effective tool for behavior change [ , ]. Evidence suggests that text messaging interventions may increase medication adherence among children and adolescents living with other chronic diseases such as asthma and diabetes [ - ]. Several studies have used both daily and weekly unidirectional, standardized SMS medication reminders for HIV-positive individuals in low-resource settings, but no published data have evaluated SMS medication reminders among youth living with HIV/AIDS in the United States [ - ].
In particular, text messaging is well suited as a vehicle for ecological momentary interventions; that is, mobile technology can provide treatment to patients in real time and in their natural environments . Additionally, recent reviews of the literature on text messaging interventions for health behavior change have identified key characteristics for success, including interactivity and tailoring of messages, which were associated with higher retention rates in multiple studies [ ].
The purpose of this pilot study was to evaluate the feasability, acceptability, and preliminary efficacy of an interactive text message reminder intervention for HIV-positive youth aged 14–29 years with demonstrated poor ART adherence. In particular, we sought to establish the feasibility of using personal cell phones for the intervention and our ability to retain youth living with HIV/AIDS as participants over the study period. We chose to pilot this intervention among youth with difficulty adhering to ART, since they could potentially benefit most from the reminders. We did not include a control condition given the lack of any pilot data to support this approach; therefore, the aims of this study were largely exploratory and meant to assess initial efficacy for a larger controlled trial.
Eligibility criteria included HIV-positive serostatus, age 14–29 years, use of personal cell phone, English-speaking, and being on ART with poor adherence. We defined poor adherence as (1) missing more than 3 medication doses in the last month, or (2) missing any doses in the last month and not achieving viral supression after 24 weeks of an appropriate regimen, or (3) being referred from a clinician who documented poor adherence in the medical record defined by a report of any missed doses to any member of the care team or not achieving viral supression in the expected time period on an appropriate regimen. Possible participants were recruited primarily from a multidisciplinary program providing medical care and other support services to youth living with HIV/AIDS, located at a lesbian, gay, bisexual, and transgender-focused health center, and serving mainly young men who have sex with men of color who have acquired HIV through sexual activity. In this convenience sample, participants were recruited and enrolled consecutively from June to November 2009 and agreed to receive text messages over a 24-week study period. Participants received a US $40 incentive at each visit to compensate for time, transportation costs, and any additional charges incurred from the daily text messages.
At baseline, we collected demographic information and screened participants for depression and substance abuse, as these have been identified as factors affecting adherence [, ]. We collaborated with Intelecare, a Health Insurance Portability and Accountability Act- and Health Information Technology for Economic and Clinical Health Act-compliant vendor of SMS health-related reminder services. At the time of enrollment, patients worked with the study coordinator to design their own personalized SMS reminder messages, which were programmed through Intelecare’s website to be delivered daily at the time(s) specified. Participants also designed a personalized follow-up message 1 hour later assessing whether they took the medication, and asking participants to respond via text message with the number 1 if they took the medication and 2 if they did not. Patients were encouraged to consider developing messages that would respect their privacy if they did not want to disclose their HIV diagnosis. Participants were able to contact the study coordinator to change the message at any time throughout the study period, and patients were asked to contact the study coordinator to reprogram the message if at any time their mobile service was interrupted.
Follow-up visits at 6, 12, 18, and 24 weeks included assessments of adherence by visual analog scale (VAS) and the AIDS Clinical Trials Group (ACTG) adherence questionnaire and satisfaction surveys. The VAS prompts participants to rate adherence in the last 4 weeks on a scale of 0% to 100%. The VAS correlates highly with unannounced pill counts, 3-day adherence recall, and viral load (ie, r > .7) [, ]. Additionally, participants responded to the following question from the ACTG adherence questionnaire (on a scale of 0 = never to 4 = all the time): “Over the past 4 days, how closely did you follow your specific medication schedule?” Viral load (HIV type 1 ribonucleic acid quantification) and CD4 cell count (absolute and percentage) were abstracted from the patient’s chart at baseline and at 12 and 24 weeks. See for details of the study design and for screenshots of the Intelecare platform used to send, recieve, and manage text message data. Study completion was defined as attendance at all study visits; responding daily to text messages was encouraged but not required for study completion.
Descriptive and distributional analyses were performed to describe the sample. Pre–post comparison of mean values and related effect sizes (standardized and unstandardized) were used to evaluate outcomes of interest. This pilot study was not powered to detect statistically significant differences. For assessment of pre–post changes in adherence levels and biomarkers, we compared scores using a t test for paired samples, with a significance level set at P ≤ .05 (2-tailed test), with Cohen d calculated as a standardized measure of effect size (controlling for dependency in paired values).
Participants were primarily male and of racial ethnic minorities, and had acquired HIV through unprotected sex (see). The main outcome of interest was change in adherence at the 12- and 24-week follow-ups (in comparison with baseline) as measured on the VAS. Mean VAS scores and responses on the ACTG 4-day adherence recall significantly increased at the 12- and 24-week follow-ups in comparison with baseline (see and ). On average, participants increased from a baseline value of 74.7 on the VAS to over 90.0 at both the 12- and 24-week follow-ups, with a standardized effects size (Cohen d) greater than 1.0 at both follow-up points. Improvements in adherence measures were seen as early as 6 weeks and sustained throughout the 24-week study period. There was no significant difference in CD4 cell count or viral load between baseline and the 12- or 24-week follow-ups, although there was a trend toward improvement of these biomarkers and a small to moderate standardized effect size (range of Cohen d: –0.51 to 0.22).
|Characteristic||Mean or n||SD or %||Range|
|Age (years), mean (SD)||23||3.08||14–29|
|Time since diagnosis (months), mean (SD)||41||43.4b||7–180|
|Time since starting current ARTa regimen (months), mean (SD)||37||59.4b||1–240|
|Gender, n (%)|
|Race/ethnicity, n (%)|
|Mode of transmission, n (%)|
|Medication regimen frequency, n (%)|
|Outcome measure||Baseline||12 weeks||24 weeks|
|Mean||SD||Mean||SD||P value||Mean||SD||P value|
|Prior 4-day adherence (ACTGb)||2.33||1.1||3.24||0.4||.002||3.19||0.9||.005|
|CD4 cell count||501.5||239.2||552.8||234.3||.12||544.8||228.7||.37|
|Outcome measure||12 weeks||24 weeks|
|Change||95% CIa||P value||Effect size (Cohen d)||Change||95% CI||P value||Effect size (Cohen d)|
|Prior 4-day adherence (ACTGc)||0.9||0.4–1.4||.002||0.87||0.9||0.3–1.4||.005||0.73|
|Viral loadd||–2509.7||–7067.0 to 2047.6||.26||–0.41||–2721.7||–7306.7 to 1863.3||.23||–0.51|
|CD4 cell countd||51.3||–15.05 to 117.6||.12||0.4||43.3||–56.3 to 142.9||.37||0.22|
Enrollment and retention of the study population was feasible with 25 participants enrolled over a 6-month period (approximately 4 participants enrolled per month), and with 23 of 25 (92%) and 21 of 25 (84%) of participants completing all visits at 12 and 24 weeks, respectively (see). Of the 4 participants who did not complete the study, only 3 were lost to follow-up; 1 had to be removed because of cell phone service incompatibility with Intelecare technology. Of note, several participants experienced a lapse in cell phone service (some due to change in phone number, failure of payment, or a lost phone, and 1 patient had the mobile phone stolen during an assault), and none reported it directly to the study coordinator, but all reported the interruption to their medical provider or case manager during routine care, and the study coordinator was then notified and messages were reprogrammed.
The intervention was rated highly on indicators of satisfaction: at the 24-week follow-up, 17 of 21 (81%) participants who completed the study said they would like to continue to receive text messages after the end of the study, and 20 of 21 (95%) participants indicated that the text messages helped them “very much” to miss fewer doses of medication. Reasons why participants did not find reminders helpful included being at work during the day when they received the text message and wanting to take their medications but not being able to check messages; not having medications on hand; living temporarily at a friend’s house where they were unable to store medications; and being in a public place where they felt uncomfortable taking their medications. Of note, all participants who completed the study (n = 21) felt that the intervention would have been helpful when they first started taking medication.
During the study period 15,387 messages were sent and received through the Intelecare platform. Of the outgoing messages sent 1167 messages were not delivered and 14,220 messages were successfully sent. Of the 7110 messages requesting a response, 3414 (48.02%) text message replies were sent by participants indicating whether they took their medications.
|Feasibility (n = 25)|
|Rate of study completion||21||84%|
|Acceptability (n = 21)|
|Helpful to avoid missed doses?||20||95%|
|Helpful to remember refills?||16||76%|
|Helpful to remember medical appointments?||15||71%|
|Messages respected privacy?||21||100%|
|Received all messages?||17||81%|
|Would like to continue to receive reminders?||17||81%|
|Reminders would have been helpful when starting medications?||21||100%|
In this sample of 25 HIV-positive youth with previous difficulty adhering to ART, personalized, daily text messaging significantly improved self-reported adherence from baseline to 12 and 24 weeks. Retention in the study was excellent, participants reported high levels of satisfaction, and the vast majority wanted to continue receiving reminders after the 24-week study period was completed. The lack of a significant difference in biomarkers (CD4 cell count and viral load) was likely due to the small sample size.
Major limitations of the study include absence of a control group and lack of long-term follow-up after completion of the intervention. However, given the paucity of data showing any effective intervention to improve adherence among youth living with HIV/AIDS, the pre–post difference reported in this study is an important finding. In one study that did show improvement with weekly text reminders and no improvement with daily reminders among poorly adherent adults living with HIV/AIDS, patients in the control group had worse virologic and self-reported adherence than at baseline . In the present study, rates of self-reported adherence and virologic suppression improved beginning at 6 weeks and were sustained over the 24-week study period, in contrast to Pop-Eleches and colleagues’ study, where standardized weekly and daily texts had a waning effect on self-reported adherence and treatment interruptions over time [ ]. A recent randomized controlled trial of 19 adults living with HIV with poor adherence showed a similar improvement in adherence by self-report for those participants randomly assigned to text message reminders personalized by topic versus no change in adherence for those randomly assigned to a reminder beep on a pager [ ]. This study followed patients for 6 weeks and did not include any biomarkers for adherence. The similar rates of improved self-reported adherence sustained over a longer period in our study, along with a trend toward improvement and a moderate standardized effect size for the difference in viral load from baseline to 24 weeks, further support the possible utility of this intervention.
Additionally, previous studies of text messaging interventions to improve adherence have used an interactive function and tailored messages, but none have included a daily, real-time interactive feature, and messages were not created individually by participants. This study showed that it is feasible to employ this intervention for a difficult-to-reach population using their own mobile phones. The unique, interactive feature of this intervention may provide additional information about timing of missed doses and help to uncover barriers to adherence, other than simply forgetting, that medical providers could use to problem solve with patients. For example, algorithms could be programmed so that if a patient did not respond for a certain number of days the provider and patient could be alerted to contact each other and address any issues in real time as opposed to waiting for the next routine clinic visit.
In summary, this pilot study demonstrates that a daily, interactive, personalized text message reminder intervention is both feasable and acceptable and shows promise as a tool to help HIV-positive youth adhere to ART. Larger controlled studies are needed to determine the potential of this intervention, not only to improve adherence to ART, but also to affect a broad range of related health outcomes for youth living with HIV/AIDS.
The authors would like to acknowledge the Howard Brown Health Center research and clinical staff, and Intelecare for their support of this study, as well as Susan S Lee for her assistance in preparing the manuscript.
All of the authors are responsible and qualified for the reported research. They have all participated in the concept and design, analysis and interpretation of data, and drafting and revision of the manuscript, and approve the manuscript as submitted. All of the authors have had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Conflicts of Interest
Multimedia Appendix 1
Intelecare platform for creating, sending, receiving, and managing text messages.PDF File (Adobe PDF File), 1MB
- Centers for Disease Control and Prevention. 2011 Jul 11. HIV Surveillance Report URL: http://www.cdc.gov/hiv/topics/surveillance/resources/reports/index.htm [accessed 2011-11-16] [WebCite Cache]
- Centers for Disease Control and Prevention. 2011 Jul 14. HIV Surveillance in Adolescents and Young Adults URL: http://www.cdc.gov/hiv/topics/surveillance/resources/slides/adolescents/index.htm [accessed 2011-11-16] [WebCite Cache]
- Flynn PM, Rudy BJ, Douglas SD, Lathey J, Spector SA, Martinez J, Pediatric AIDS Clinical Trial Group 381 Study Team. Virologic and immunologic outcomes after 24 weeks in HIV type 1-infected adolescents receiving highly active antiretroviral therapy. J Infect Dis 2004 Jul 15;190(2):271-279 [FREE Full text] [CrossRef] [Medline]
- Gross R, Bilker WB, Friedman HM, Strom BL. Effect of adherence to newly initiated antiretroviral therapy on plasma viral load. AIDS 2001 Nov 9;15(16):2109-2117. [Medline]
- Paterson DL, Swindells S, Mohr J, Brester M, Vergis EN, Squier C, et al. Adherence to protease inhibitor therapy and outcomes in patients with HIV infection. Ann Intern Med 2000 Jul 4;133(1):21-30. [Medline]
- Quinn TC, Wawer MJ, Sewankambo N, Serwadda D, Li C, Wabwire-Mangen F, et al. Viral load and heterosexual transmission of human immunodeficiency virus type 1. Rakai Project Study Group. N Engl J Med 2000 Mar 30;342(13):921-929 [FREE Full text] [CrossRef] [Medline]
- Tang JW, Pillay D. Transmission of HIV-1 drug resistance. J Clin Virol 2004 May;30(1):1-10. [CrossRef] [Medline]
- Belzer ME, Fuchs DN, Luftman GS, Tucker DJ. Antiretroviral adherence issues among HIV-positive adolescents and young adults. J Adolesc Health 1999 Nov;25(5):316-319. [Medline]
- Murphy DA, Wilson CM, Durako SJ, Muenz LR, Belzer M, Adolescent Medicine HIV/AIDS Research Network. Antiretroviral medication adherence among the REACH HIV-infected adolescent cohort in the USA. AIDS Care 2001 Feb;13(1):27-40. [CrossRef] [Medline]
- Naar-King S, Templin T, Wright K, Frey M, Parsons JT, Lam P. Psychosocial factors and medication adherence in HIV-positive youth. AIDS Patient Care STDS 2006 Jan;20(1):44-47. [CrossRef] [Medline]
- Rao D, Kekwaletswe TC, Hosek S, Martinez J, Rodriguez F. Stigma and social barriers to medication adherence with urban youth living with HIV. AIDS Care 2007 Jan;19(1):28-33. [CrossRef] [Medline]
- Chesney MA, Ickovics JR, Chambers DB, Gifford AL, Neidig J, Zwickl B, et al. Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: the AACTG adherence instruments. Patient Care Committee & Adherence Working Group of the Outcomes Committee of the Adult AIDS Clinical Trials Group (AACTG). AIDS Care 2000 Jun;12(3):255-266. [CrossRef] [Medline]
- Glikman D, Walsh L, Valkenburg J, Mangat PD, Marcinak JF. Hospital-based directly observed therapy for HIV-infected children and adolescents to assess adherence to antiretroviral medications. Pediatrics 2007 May;119(5):e1142-e1148 [FREE Full text] [CrossRef] [Medline]
- Parsons GN, Siberry GK, Parsons JK, Christensen JR, Joyner ML, Lee SL, et al. Multidisciplinary, inpatient directly observed therapy for HIV-1-infected children and adolescents failing HAART: A retrospective study. AIDS Patient Care STDS 2006 Apr;20(4):275-284. [CrossRef] [Medline]
- Puccio JA, Belzer M, Olson J, Martinez M, Salata C, Tucker D, et al. The use of cell phone reminder calls for assisting HIV-infected adolescents and young adults to adhere to highly active antiretroviral therapy: a pilot study. AIDS Patient Care STDS 2006 Jun;20(6):438-444. [CrossRef] [Medline]
- Purdy JB, Freeman AF, Martin SC, Ryder C, Elliott-DeSorbo DK, Zeichner S, et al. Virologic response using directly observed therapy in adolescents with HIV: an adherence tool. J Assoc Nurses AIDS Care 2008;19(2):158-165. [CrossRef] [Medline]
- Rogers AS, Miller S, Murphy DA, Tanney M, Fortune T. The TREAT (Therapeutic Regimens Enhancing Adherence in Teens) program: theory and preliminary results. J Adolesc Health 2001 Sep;29(3 Suppl):30-38. [Medline]
- Lenhart A, Ling R, Campbell S, Purcell K. Teens and mobile phones. Washington, DC: Pew Internet & American Life Project; 2010 Apr 20. URL: http://www.pewinternet.org/~/media//Files/Reports/2010/PIP-Teens-and-Mobile-2010-with-topline.pdf [accessed 2011-11-16] [WebCite Cache]
- Fjeldsoe BS, Marshall AL, Miller YD. Behavior change interventions delivered by mobile telephone short-message service. Am J Prev Med 2009 Feb;36(2):165-173. [CrossRef] [Medline]
- Wei J, Hollin I, Kachnowski S. A review of the use of mobile phone text messaging in clinical and healthy behaviour interventions. J Telemed Telecare 2011;17(1):41-48. [CrossRef] [Medline]
- Hung SH, Tseng HC, Tsai WH, Lin HH, Cheng JH, Chang YM. Care for Asthma via Mobile Phone (CAMP). Stud Health Technol Inform 2007;126:137-143. [Medline]
- Neville R, Greene A, McLeod J, Tracey A, Tracy A, Surie J. Mobile phone text messaging can help young people manage asthma. BMJ 2002 Sep 14;325(7364):600. [Medline]
- Franklin V, Waller A, Pagliari C, Greene S. "Sweet Talk": text messaging support for intensive insulin therapy for young people with diabetes. Diabetes Technol Ther 2003;5(6):991-996. [CrossRef] [Medline]
- Franklin VL, Waller A, Pagliari C, Greene SA. A randomized controlled trial of Sweet Talk, a text-messaging system to support young people with diabetes. Diabet Med 2006 Dec;23(12):1332-1338. [CrossRef] [Medline]
- Miloh T, Annunziato R, Arnon R, Warshaw J, Parkar S, Suchy FJ, et al. Improved adherence and outcomes for pediatric liver transplant recipients by using text messaging. Pediatrics 2009 Nov;124(5):e844-e850 [FREE Full text] [CrossRef] [Medline]
- Pop-Eleches C, Thirumurthy H, Habyarimana JP, Zivin JG, Goldstein MP, de Walque D, et al. Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders. AIDS 2011 Mar 27;25(6):825-834. [CrossRef] [Medline]
- De Costa A, Shet A, Kumarasamy N, Ashorn P, Eriksson B, Bogg L, HIVIND study team. Design of a randomized trial to evaluate the influence of mobile phone reminders on adherence to first line antiretroviral treatment in South India--the HIVIND study protocol. BMC Med Res Methodol 2010;10:25 [FREE Full text] [CrossRef] [Medline]
- Lester RT, Mills EJ, Kariri A, Ritvo P, Chung M, Jack W, et al. The HAART cell phone adherence trial (WelTel Kenya1): a randomized controlled trial protocol. Trials 2009;10:87 [FREE Full text] [CrossRef] [Medline]
- Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol 2010 Feb;15(Pt 1):1-39. [CrossRef] [Medline]
- Cole-Lewis H, Kershaw T. Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev 2010 Apr;32(1):56-69. [CrossRef] [Medline]
- Nugent NR, Brown LK, Belzer M, Harper GW, Nachman S, Naar-King S, Adolescent Trials Network for HIV/AIDS Interventions. Youth living with HIV and problem substance use: elevated distress is associated with nonadherence and sexual risk. J Int Assoc Physicians AIDS Care (Chic) 2010;9(2):113-115. [CrossRef] [Medline]
- Walsh JC, Mandalia S, Gazzard BG. Responses to a 1 month self-report on adherence to antiretroviral therapy are consistent with electronic data and virological treatment outcome. AIDS 2002 Jan 25;16(2):269-277. [Medline]
- Giordano TP, Guzman D, Clark R, Charlebois ED, Bangsberg DR. Measuring adherence to antiretroviral therapy in a diverse population using a visual analogue scale. HIV Clin Trials 2004;5(2):74-79 [FREE Full text] [Medline]
- Hardy H, Kumar V, Doros G, Farmer E, Drainoni ML, Rybin D, et al. Randomized controlled trial of a personalized cellular phone reminder system to enhance adherence to antiretroviral therapy. AIDS Patient Care STDS 2011 Mar;25(3):153-161. [CrossRef] [Medline]
|ACTG: AIDS Clinical Trial Group|
|AIDS: acquired immunodeficiency syndrome|
|ART: antiretroviral therapy|
|HIV: human immunodeficiency virus|
|SMS: short message service|
|VAS: visual analog scale|
Edited by G Eysenbach; submitted 26.11.11; peer-reviewed by K MacDonell; comments to author 15.01.12; revised version received 18.01.12; accepted 19.01.12; published 05.04.12
©Nadia Dowshen, Lisa M Kuhns, Amy Johnson, Brian James Holoyda, Robert Garofalo. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 05.04.2012.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.