Published on in Vol 20, No 4 (2018): April

Preprints (earlier versions) of this paper are available at, first published .
Assessing Therapeutic Alliance in the Context of mHealth Interventions for Mental Health Problems: Development of the Mobile Agnew Relationship Measure (mARM) Questionnaire

Assessing Therapeutic Alliance in the Context of mHealth Interventions for Mental Health Problems: Development of the Mobile Agnew Relationship Measure (mARM) Questionnaire

Assessing Therapeutic Alliance in the Context of mHealth Interventions for Mental Health Problems: Development of the Mobile Agnew Relationship Measure (mARM) Questionnaire


  1. Blease C, Delbanco T, Torous J, Ponten M, DesRoches C, Hagglund M, Walker J, Kirsch I. Sharing clinical notes, and placebo and nocebo effects: Can documentation affect patient health?. Journal of Health Psychology 2022;27(1):135 View
  2. Henson P, Wisniewski H, Hollis C, Keshavan M, Torous J. Digital mental health apps and the therapeutic alliance: initial review. BJPsych Open 2019;5(1) View
  3. Gonsalves P, Hodgson E, Kumar A, Aurora T, Chandak Y, Sharma R, Michelson D, Patel V. Design and Development of the “POD Adventures” Smartphone Game: A Blended Problem-Solving Intervention for Adolescent Mental Health in India. Frontiers in Public Health 2019;7 View
  4. Tremain H, McEnery C, Fletcher K, Murray G. The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review. JMIR Mental Health 2020;7(8):e17204 View
  5. Schroeder J, Karkar R, Murinova N, Fogarty J, Munson S. Examining Opportunities for Goal-Directed Self-Tracking to Support Chronic Condition Management. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2019;3(4):1 View
  6. Kemp J, Zhang T, Inglis F, Wiljer D, Sockalingam S, Crawford A, Lo B, Charow R, Munnery M, Singh Takhar S, Strudwick G. Delivery of Compassionate Mental Health Care in a Digital Technology–Driven Age: Scoping Review. Journal of Medical Internet Research 2020;22(3):e16263 View
  7. Bucci S, Schwannauer M, Berry N. The digital revolution and its impact on mental health care. Psychology and Psychotherapy: Theory, Research and Practice 2019;92(2):277 View
  8. Bucci S, Berry N, Morris R, Berry K, Haddock G, Lewis S, Edge D. “They Are Not Hard-to-Reach Clients. We Have Just Got Hard-to-Reach Services.” Staff Views of Digital Health Tools in Specialist Mental Health Services.. Frontiers in Psychiatry 2019;10 View
  9. Miloff A, Carlbring P, Hamilton W, Andersson G, Reuterskiöld L, Lindner P. Measuring Alliance Toward Embodied Virtual Therapists in the Era of Automated Treatments With the Virtual Therapist Alliance Scale (VTAS): Development and Psychometric Evaluation. Journal of Medical Internet Research 2020;22(3):e16660 View
  10. Herrero R, Vara M, Miragall M, Botella C, García-Palacios A, Riper H, Kleiboer A, Baños R. Working Alliance Inventory for Online Interventions-Short Form (WAI-TECH-SF): The Role of the Therapeutic Alliance between Patient and Online Program in Therapeutic Outcomes. International Journal of Environmental Research and Public Health 2020;17(17):6169 View
  11. Eisner E, Drake R, Berry N, Barrowclough C, Emsley R, Machin M, Bucci S. Development and Long-Term Acceptability of ExPRESS, a Mobile Phone App to Monitor Basic Symptoms and Early Signs of Psychosis Relapse. JMIR mHealth and uHealth 2019;7(3):e11568 View
  12. Doukani A, Free C, Michelson D, Araya R, Montero-Marin J, Smith S, Cerga-Pashoja A, Kakuma R. Towards a conceptual framework of the working alliance in a blended low-intensity cognitive behavioural therapy intervention for depression in primary mental health care: a qualitative study. BMJ Open 2020;10(9):e036299 View
  13. Mehrotra S, Tripathi R. Recent developments in the use of smartphone interventions for mental health. Current Opinion in Psychiatry 2018;31(5):379 View
  14. Lopez A, Schwenk S, Schneck C, Griffin R, Mishkind M. Technology-Based Mental Health Treatment and the Impact on the Therapeutic Alliance. Current Psychiatry Reports 2019;21(8) View
  15. D’Alfonso S. AI in mental health. Current Opinion in Psychology 2020;36:112 View
  16. Minen M, Corner S, Berk T, Levitan V, Friedman S, Adhikari S, Seng E. Heartrate variability biofeedback for migraine using a smartphone application and sensor: A randomized controlled trial. General Hospital Psychiatry 2021;69:41 View
  17. Henson P, Peck P, Torous J. Considering the Therapeutic Alliance in Digital Mental Health Interventions. Harvard Review of Psychiatry 2019;27(4):268 View
  18. Balcombe L, De Leo D. Psychological Screening and Tracking of Athletes and Digital Mental Health Solutions in a Hybrid Model of Care: Mini Review. JMIR Formative Research 2020;4(12):e22755 View
  19. Prochaska J, Vogel E, Chieng A, Kendra M, Baiocchi M, Pajarito S, Robinson A. A Therapeutic Relational Agent for Reducing Problematic Substance Use (Woebot): Development and Usability Study. Journal of Medical Internet Research 2021;23(3):e24850 View
  20. Kellett S, Easton K, Cooper M, Millings A, Simmonds-Buckley M, Parry G. Evaluation of a Mobile App to Enhance Relational Awareness and Change During Cognitive Analytic Therapy: Mixed Methods Case Series. JMIR Mental Health 2020;7(12):e19888 View
  21. Stubbe D. Enhancing Adherence: Using Mobile Health Technology to Improve Self-Management for Individuals With Schizophrenia. FOCUS 2020;18(4):424 View
  22. D'Alfonso S, Lederman R, Bucci S, Berry K. The Digital Therapeutic Alliance and Human-Computer Interaction. JMIR Mental Health 2020;7(12):e21895 View
  23. González-Robles A, Suso-Ribera C, Díaz-García A, García-Palacios A, Castilla D, Botella C. Predicting response to transdiagnostic iCBT for emotional disorders from patient and therapist involvement. Internet Interventions 2021;25:100420 View
  24. Mortimer R, Somerville M, Mechler J, Lindqvist K, Leibovich L, Guerrero-Tates B, Edbrooke-Childs J, Martin P, Midgley N. Connecting over the internet: Establishing the therapeutic alliance in an internet-based treatment for depressed adolescents. Clinical Child Psychology and Psychiatry 2022;27(3):549 View
  25. Getty C, Weaver T, Metrebian N. A qualitative exploration of patients' experience of mobile telephone‐delivered contingency management to promote adherence to supervised methadone. Drug and Alcohol Review 2023;42(3):641 View
  26. Gega L, Jankovic D, Saramago P, Marshall D, Dawson S, Brabyn S, Nikolaidis G, Melton H, Churchill R, Bojke L. Digital interventions in mental health: evidence syntheses and economic modelling. Health Technology Assessment 2022;26(1):1 View
  27. Cliffe B, Stokes Z, Stallard P. The Acceptability of a Smartphone App (BlueIce) for University Students Who Self-harm. Archives of Suicide Research 2023;27(2):565 View
  28. Goldberg S, Baldwin S, Riordan K, Torous J, Dahl C, Davidson R, Hirshberg M. Alliance With an Unguided Smartphone App: Validation of the Digital Working Alliance Inventory. Assessment 2022;29(6):1331 View
  29. Luo X, Bugatti M, Molina L, Tilley J, Mahaffey B, Gonzalez A. Conceptual Invariance, Trajectories, and Outcome Associations of Working Alliance in Unguided and Guided Internet-Based Psychological Interventions: Secondary Analysis of a Randomized Controlled Trial. JMIR Mental Health 2022;9(6):e35496 View
  30. Valentine L, D’Alfonso S, Lederman R. Recommender systems for mental health apps: advantages and ethical challenges. AI & SOCIETY 2023;38(4):1627 View
  31. Tong F, Lederman R, D'Alfonso S, Berry K, Bucci S. Digital Therapeutic Alliance With Fully Automated Mental Health Smartphone Apps: A Narrative Review. Frontiers in Psychiatry 2022;13 View
  32. Völter C, Stöckmann C, Klein H, Dazert S, Thomas J. Teletherapie nach Cochleaimplantation in der COVID-19-Pandemie. HNO 2022;70(3):214 View
  33. Prochaska J, Vogel E, Chieng A, Baiocchi M, Maglalang D, Pajarito S, Weingardt K, Darcy A, Robinson A. A randomized controlled trial of a therapeutic relational agent for reducing substance misuse during the COVID-19 pandemic. Drug and Alcohol Dependence 2021;227:108986 View
  34. Bongers I, Buitenweg D, van Kuijk R, van Nieuwenhuizen C. I Need to Know: Using the CeHRes Roadmap to Develop a Treatment Feedback Tool for Youngsters with Mental Health Problems. International Journal of Environmental Research and Public Health 2022;19(17):10834 View
  35. Marcu G, Ondersma S, Spiller A, Broderick B, Kadri R, Buis L. Barriers and Considerations in the Design and Implementation of Digital Behavioral Interventions: Qualitative Analysis. Journal of Medical Internet Research 2022;24(3):e34301 View
  36. He X, Peng C, Xu Y, Zhang Y, Wang Z. Global Scientific Research Landscape on Medical Informatics From 2011 to 2020: Bibliometric Analysis. JMIR Medical Informatics 2022;10(4):e33842 View
  37. Prochaska J, Vogel E, Chieng A, Baiocchi M, Pajarito S, Pirner M, Darcy A, Robinson A. A relational agent for treating substance use in adults: Protocol for a randomized controlled trial with a psychoeducational comparator. Contemporary Clinical Trials 2023;127:107125 View
  38. Jabir A, Martinengo L, Lin X, Torous J, Subramaniam M, Tudor Car L. Evaluating Conversational Agents for Mental Health: Scoping Review of Outcomes and Outcome Measurement Instruments. Journal of Medical Internet Research 2023;25:e44548 View
  39. Tong F, Lederman R, D'Alfonso S, Berry K, Bucci S. Conceptualizing the digital therapeutic alliance in the context of fully automated mental health apps: A thematic analysis. Clinical Psychology & Psychotherapy 2023;30(5):998 View
  40. Dadlani A, Bernstein S, Welton R. Assessing Medical Students’ Comfort with Telemedicine. Southern Medical Journal 2023;116(5):400 View
  41. Kiburi S, Paruk S, Kwobah E, Chiliza B, Ayatollahi H. Exploring user experiences of a text message-delivered intervention among individuals on opioid use disorder treatment in Kenya: A qualitative study. PLOS Digital Health 2023;2(11):e0000375 View
  42. von Wulffen C, Marciniak M, Rohde J, Kalisch R, Binder H, Tuescher O, Kleim B. German Version of the Mobile Agnew Relationship Measure: Translation and Validation Study. Journal of Medical Internet Research 2023;25:e43368 View
  43. Maddison C, Wharrad H, Archard P, O’Reilly M. Exploring young people’s perspectives on digital technology and mental healthcare: pilot study findings. Mental Health Practice 2024;27(1):34 View
  44. Ashur O, Muench F, Baumel A. Evaluating the Contribution of New Factors in the Assessment of eHealth Therapeutic Alliance. Journal of Technology in Behavioral Science 2023 View
  45. Hassan L, Eisner E, Berry K, Emsley R, Ainsworth J, Lewis S, Haddock G, Edge D, Bucci S. User engagement in a randomised controlled trial for a digital health intervention for early psychosis (Actissist 2.0 trial). Psychiatry Research 2023;329:115536 View
  46. Brady J, Livingston N, Sawdy M, Yeksigian K, Zhou S, Bickmore T, Simon S, Rubin A. Development and Evaluation of a Relational Agent to Assist with Screening and Intervention for Unhealthy Drinking in Primary Care. Journal of Technology in Behavioral Science 2023;8(4):432 View
  47. Grodniewicz J, Hohol M. Waiting for a digital therapist: three challenges on the path to psychotherapy delivered by artificial intelligence. Frontiers in Psychiatry 2023;14 View
  48. White J, Salem M, Toussaert S, Westmaas J, Raiff B, Crane D, Warrender E, Lyles C, Abroms L, Thrul J. Developing a Game (Inner Dragon) Within a Leading Smartphone App for Smoking Cessation: Design and Feasibility Evaluation Study. JMIR Serious Games 2023;11:e46602 View
  49. Bright A, Doody O. Mental health service users' experiences of telehealth interventions facilitated during the COVID‐19 pandemic and their relevance to nursing: An integrative review. Journal of Psychiatric and Mental Health Nursing 2023;30(6):1114 View
  50. Litt M. Do you need a therapist to have a therapeutic alliance? Comment on Benitez et al., “The connection still matters: Therapeutic alliance with digital treatment for alcohol use disorder”. Alcohol: Clinical and Experimental Research 2024 View
  51. Pettitt A, Nelson B, Forman‐Hoffman V, Goldin P, Peiper N. Longitudinal outcomes of a therapist‐supported digital mental health intervention for depression and anxiety symptoms: A retrospective cohort study. Psychology and Psychotherapy: Theory, Research and Practice 2024 View
  52. Stiles B, Halverson T, Stone A, Still C, Gleeson J, Alvarez‐Jimenez M, Perkins D, Penn D. The effect of the alliance on social recovery outcomes and usage in a moderated online social therapy for first‐episode psychosis. Psychology and Psychotherapy: Theory, Research and Practice 2024 View

Books/Policy Documents

  1. Kaveladze B, Schueller S. Digital Therapeutics for Mental Health and Addiction. View