Published on in Vol 21, No 9 (2019): September

Preprints (earlier versions) of this paper are available at, first published .
Objective User Engagement With Mental Health Apps: Systematic Search and Panel-Based Usage Analysis

Objective User Engagement With Mental Health Apps: Systematic Search and Panel-Based Usage Analysis

Objective User Engagement With Mental Health Apps: Systematic Search and Panel-Based Usage Analysis


  1. Torous J, Jän Myrick K, Rauseo-Ricupero N, Firth J. Digital Mental Health and COVID-19: Using Technology Today to Accelerate the Curve on Access and Quality Tomorrow. JMIR Mental Health 2020;7(3):e18848 View
  2. Kramer J, Künzler F, Mishra V, Smith S, Kotz D, Scholz U, Fleisch E, Kowatsch T. Which Components of a Smartphone Walking App Help Users to Reach Personalized Step Goals? Results From an Optimization Trial. Annals of Behavioral Medicine 2020;54(7):518 View
  3. Torous J, Lipschitz J, Ng M, Firth J. Dropout rates in clinical trials of smartphone apps for depressive symptoms: A systematic review and meta-analysis. Journal of Affective Disorders 2020;263:413 View
  4. Huckvale K, Nicholas J, Torous J, Larsen M. Smartphone apps for the treatment of mental health conditions: status and considerations. Current Opinion in Psychology 2020;36:65 View
  5. Torous J, Vaidyam A. Multiple uses of app instead of using multiple apps – a case for rethinking the digital health technology toolbox. Epidemiology and Psychiatric Sciences 2020;29 View
  6. Hsia B, Mowrey W, Keskin T, Wu S, Aita R, Kwak L, Ferastraoarou D, Rosenstreich D, Jariwala S. Developing and pilot testing ASTHMAXcel, a mobile app for adults with asthma. Journal of Asthma 2021;58(6):834 View
  7. Gooding P, Resnick K. Psychiatry and law in the digital age: untangling the hype, risk and promise. International Journal of Law and Psychiatry 2020;70:101553 View
  8. Taylor C, Ruzek J, Fitzsimmons-Craft E, Sadeh-Sharvit S, Topooco N, Weissman R, Eisenberg D, Mohr D, Graham A, Jacobi C, Oldenburg B. Using Digital Technology to Reduce the Prevalence of Mental Health Disorders in Populations: Time for a New Approach. Journal of Medical Internet Research 2020;22(7):e17493 View
  9. Torous J, Brady R. Advancing care for bipolar disorder today and breakthroughs in access and treatments tomorrow with mobile health and smartphone apps. Bipolar Disorders 2020;22(3):211 View
  10. Figueroa C, Aguilera A. The Need for a Mental Health Technology Revolution in the COVID-19 Pandemic. Frontiers in Psychiatry 2020;11 View
  11. Shinn E, Jensen K, McLaughlin J, Garden A, Fellman B, Liang L, Peterson S. Interactive website for head and neck cancer patients: Adherence and coping program to prevent dysphagia after radiation. Internet Interventions 2019;18:100289 View
  12. Graham A, Greene C, Kwasny M, Kaiser S, Lieponis P, Powell T, Mohr D. Coached Mobile App Platform for the Treatment of Depression and Anxiety Among Primary Care Patients. JAMA Psychiatry 2020;77(9):906 View
  13. Lagan S, Aquino P, Emerson M, Fortuna K, Walker R, Torous J. Actionable health app evaluation: translating expert frameworks into objective metrics. npj Digital Medicine 2020;3(1) View
  14. Conroy D, Yang C, Lanza S, Smyth J, Lagoa C. Temporal Dynamics of Treatment Receipt in a Text Message Intervention for Physical Activity: Single-Group, Within-Person Trial. JMIR mHealth and uHealth 2020;8(4):e14270 View
  15. Torous J, Powell A, Rodriguez-Villa E. Health Information Technology Resources to Support Measurement-Based Care. Child and Adolescent Psychiatric Clinics of North America 2020;29(4):763 View
  16. Allen S. COVID-19 Is Straining Mental Health—Could Technology Be the Answer?. IEEE Pulse 2020;11(4):8 View
  17. Gratzer D, Torous J, Lam R, Patten S, Kutcher S, Chan S, Vigo D, Pajer K, Yatham L. Our Digital Moment: Innovations and Opportunities in Digital Mental Health Care. The Canadian Journal of Psychiatry 2021;66(1):5 View
  18. Fitzsimmons-Craft E, Taylor C, Graham A, Sadeh-Sharvit S, Balantekin K, Eichen D, Monterubio G, Goel N, Flatt R, Karam A, Firebaugh M, Jacobi C, Jo B, Trockel M, Wilfley D. Effectiveness of a Digital Cognitive Behavior Therapy–Guided Self-Help Intervention for Eating Disorders in College Women. JAMA Network Open 2020;3(8):e2015633 View
  19. Connolly S, Hogan T, Shimada S, Miller C. Leveraging Implementation Science to Understand Factors Influencing Sustained Use of Mental Health Apps: a Narrative Review. Journal of Technology in Behavioral Science 2021;6(2):184 View
  20. Byambasuren O, Beller E, Hoffmann T, Glasziou P. Barriers to and Facilitators of the Prescription of mHealth Apps in Australian General Practice: Qualitative Study. JMIR mHealth and uHealth 2020;8(7):e17447 View
  21. Rodriguez-Villa E, Rauseo-Ricupero N, Camacho E, Wisniewski H, Keshavan M, Torous J. The digital clinic: Implementing technology and augmenting care for mental health. General Hospital Psychiatry 2020;66:59 View
  22. Wasil A, Weisz J, DeRubeis R. Three questions to consider before developing a mental health app. World Psychiatry 2020;19(2):252 View
  23. Litvin S, Saunders R, Maier M, Lüttke S, Matsuoka Y. Gamification as an approach to improve resilience and reduce attrition in mobile mental health interventions: A randomized controlled trial. PLOS ONE 2020;15(9):e0237220 View
  24. Hearn J, Finlay K, Sheffield D. ‘Trying to bring attention to your body when you’re not sure where it is’: An interpretative phenomenological analysis of drivers and barriers to mindfulness for people with spinal cord injury. British Journal of Health Psychology 2021;26(1):161 View
  25. Dekker I, De Jong E, Schippers M, De Bruijn-Smolders M, Alexiou A, Giesbers B. Optimizing Students’ Mental Health and Academic Performance: AI-Enhanced Life Crafting. Frontiers in Psychology 2020;11 View
  26. Baumel A, Fleming T, Schueller S. Digital Micro Interventions for Behavioral and Mental Health Gains: Core Components and Conceptualization of Digital Micro Intervention Care. Journal of Medical Internet Research 2020;22(10):e20631 View
  27. Alvarez-Jimenez M, Rice S, D'Alfonso S, Leicester S, Bendall S, Pryor I, Russon P, McEnery C, Santesteban-Echarri O, Da Costa G, Gilbertson T, Valentine L, Solves L, Ratheesh A, McGorry P, Gleeson J. A Novel Multimodal Digital Service (Moderated Online Social Therapy+) for Help-Seeking Young People Experiencing Mental Ill-Health: Pilot Evaluation Within a National Youth E-Mental Health Service. Journal of Medical Internet Research 2020;22(8):e17155 View
  28. Baumel A, Torous J, Edan S, Kane J. There is a non-evidence-based app for that: A systematic review and mixed methods analysis of depression- and anxiety-related apps that incorporate unrecognized techniques. Journal of Affective Disorders 2020;273:410 View
  29. Chandler C, Foltz P, Cohen A, Holmlund T, Cheng J, Bernstein J, Rosenfeld E, Elvevåg B. Machine learning for ambulatory applications of neuropsychological testing. Intelligence-Based Medicine 2020;1-2:100006 View
  30. Maricich Y, Xiong X, Gerwien R, Kuo A, Velez F, Imbert B, Boyer K, Luderer H, Braun S, Williams K. Real-world evidence for a prescription digital therapeutic to treat opioid use disorder. Current Medical Research and Opinion 2021;37(2):175 View
  31. Richardson C, Slemon A, Gadermann A, McAuliffe C, Thomson K, Daly Z, Salway T, Currie L, David A, Jenkins E. Use of Asynchronous Virtual Mental Health Resources for COVID-19 Pandemic–Related Stress Among the General Population in Canada: Cross-Sectional Survey Study. Journal of Medical Internet Research 2020;22(12):e24868 View
  32. Burchert S, Kerber A, Zimmermann J, Knaevelsrud C, Nater-Mewes R. Screening accuracy of a 14-day smartphone ambulatory assessment of depression symptoms and mood dynamics in a general population sample: Comparison with the PHQ-9 depression screening. PLOS ONE 2021;16(1):e0244955 View
  33. Serlachius A, Schache K, Boggiss A, Lim D, Wallace-Boyd K, Brenton-Peters J, Buttenshaw E, Chadd S, Cavadino A, Cao N, Morunga E, Thabrew H. Coping Skills Mobile App to Support the Emotional Well-Being of Young People During the COVID-19 Pandemic: Protocol for a Mixed Methods Study. JMIR Research Protocols 2020;9(10):e23716 View
  34. Asuzu K, Rosenthal M. Mobile device use among inpatients on a psychiatric unit: A preliminary study. Psychiatry Research 2021;297:113720 View
  35. Powell A, Torous J. A Patient-Centered Framework for Measuring the Economic Value of the Clinical Benefits of Digital Health Apps: Theoretical Modeling. JMIR Mental Health 2020;7(10):e18812 View
  36. Lattie E, Cohen K, Winquist N, Mohr D. Examining an App-Based Mental Health Self-Care Program, IntelliCare for College Students: Single-Arm Pilot Study. JMIR Mental Health 2020;7(10):e21075 View
  37. Gadermann A, Thomson K, Richardson C, Gagné M, McAuliffe C, Hirani S, Jenkins E. Examining the impacts of the COVID-19 pandemic on family mental health in Canada: findings from a national cross-sectional study. BMJ Open 2021;11(1):e042871 View
  38. Berry N, Machin M, Ainsworth J, Berry K, Edge D, Haddock G, Lewis S, Morris R, Bucci S. Developing a Theory-Informed Smartphone App for Early Psychosis: Learning Points From a Multidisciplinary Collaboration. Frontiers in Psychiatry 2020;11 View
  39. Fleming T, Lucassen M, Stasiak K, Sutcliffe K, Merry S. Technology Matters: SPARX – computerised cognitive behavioural therapy for adolescent depression in a game format. Child and Adolescent Mental Health 2021;26(1):92 View
  40. Melcher J, Camacho E, Lagan S, Torous J. College student engagement with mental health apps: analysis of barriers to sustained use. Journal of American College Health 2020:1 View
  41. Kim H, Kim Y, Park Y. Interpretable Conditional Recurrent Neural Network for Weight Change Prediction: Algorithm Development and Validation Study. JMIR mHealth and uHealth 2021;9(3):e22183 View
  42. Miller M, Davis A, McLean C. Development and Pilot Testing of a Trauma-Focused Cognitive-Behavioral Self-Management Mobile App for Post-traumatic Stress Symptoms. Journal of Technology in Behavioral Science 2021 View
  43. Lukic Y, Shih C, Hernandez Reguera A, Cotti A, Fleisch E, Kowatsch T. Physiological Responses and User Feedback on a Gameful Breathing Training App: Within-Subject Experiment. JMIR Serious Games 2021;9(1):e22802 View
  44. Alessa T, S Hawley M, Alsulamy N, de Witte L. Using a Commercially Available App for the Self-Management of Hypertension: Acceptance and Usability Study in Saudi Arabia. JMIR mHealth and uHealth 2021;9(2):e24177 View
  45. Friis-Healy E, Nagy G, Kollins S. It Is Time to REACT: Opportunities for Digital Mental Health Apps to Reduce Mental Health Disparities in Racially and Ethnically Minoritized Groups. JMIR Mental Health 2021;8(1):e25456 View
  46. Mordecai D, Histon T, Neuwirth E, Heisler W, Kraft A, Bang Y, Franchino K, Taillac C, Nixon J. How Kaiser Permanente Created a Mental Health and Wellness Digital Ecosystem. NEJM Catalyst 2021;2(1) View
  47. Bergin A, Vallejos E, Davies E, Daley D, Ford T, Harold G, Hetrick S, Kidner M, Long Y, Merry S, Morriss R, Sayal K, Sonuga-Barke E, Robinson J, Torous J, Hollis C. Preventive digital mental health interventions for children and young people: a review of the design and reporting of research. npj Digital Medicine 2020;3(1) View
  48. Lin Y, Chen S, Lin P, Tai A, Pan Y, Hsieh C, Lin S. Assessing User Retention of a Mobile App: Survival Analysis. JMIR mHealth and uHealth 2020;8(11):e16309 View
  49. Wasil A, Patel R, Cho J, Shingleton R, Weisz J, DeRubeis R. Smartphone apps for eating disorders: A systematic review of evidence‐based content and application of user‐adjusted analyses. International Journal of Eating Disorders 2021;54(5):690 View
  50. Wu A, Scult M, Barnes E, Betancourt J, Falk A, Gunning F. Smartphone apps for depression and anxiety: a systematic review and meta-analysis of techniques to increase engagement. npj Digital Medicine 2021;4(1) View
  51. Stenzel L, Röcken M, Thrien H, Stoll O. Blended Learning zur Betreuung der deutschen männlichen U19 Handballnationalmannschaft bei der WM 2019. Zeitschrift für Sportpsychologie 2020;27(4):153 View
  52. Agyapong V, Shalaby R, Hrabok M, Vuong W, Noble J, Gusnowski A, Mrklas K, Li D, Snaterse M, Surood S, Cao B, Li X, Greiner R, Greenshaw A. Mental Health Outreach via Supportive Text Messages during the COVID-19 Pandemic: Improved Mental Health and Reduced Suicidal Ideation after Six Weeks in Subscribers of Text4Hope Compared to a Control Population. International Journal of Environmental Research and Public Health 2021;18(4):2157 View
  53. Van Daele T, Best P, Bernaerts S, Van Assche E, De Witte N. Dropping the E: The potential for integrating e-mental health in psychotherapy. Current Opinion in Psychology 2021;41:46 View
  54. Fagernäs S, Hamilton W, Espinoza N, Miloff A, Carlbring P, Lindner P. What do users think about Virtual Reality relaxation applications? A mixed methods study of online user reviews using natural language processing. Internet Interventions 2021;24:100370 View
  55. Jaworski B, Taylor K, Ramsey K, Heinz A, Steinmetz S, Pagano I, Moraja G, Owen J. Exploring Usage of COVID Coach, a Public Mental Health App Designed for the COVID-19 Pandemic: Evaluation of Analytics Data. Journal of Medical Internet Research 2021;23(3):e26559 View
  56. Figueroa C, Aguilera A, Chakraborty B, Modiri A, Aggarwal J, Deliu N, Sarkar U, Jay Williams J, Lyles C. Adaptive learning algorithms to optimize mobile applications for behavioral health: guidelines for design decisions. Journal of the American Medical Informatics Association 2021;28(6):1225 View
  57. Tarricone R, Petracca F, Ciani O, Cucciniello M. Distinguishing features in the assessment of mHealth apps. Expert Review of Pharmacoeconomics & Outcomes Research 2021:1 View
  58. Prochaska J, Vogel E, Chieng A, Kendra M, Baiocchi M, Pajarito S, Robinson A. A Therapeutic Relational Agent for Reducing Problematic Substance Use (Woebot): Development and Usability Study. Journal of Medical Internet Research 2021;23(3):e24850 View
  59. Viczko J, Tarrant J, Jackson R. Effects on Mood and EEG States After Meditation in Augmented Reality With and Without Adjunctive Neurofeedback. Frontiers in Virtual Reality 2021;2 View
  60. Rauseo-Ricupero N, Henson P, Agate-Mays M, Torous J. Case studies from the digital clinic: integrating digital phenotyping and clinical practice into today’s world. International Review of Psychiatry 2021;33(4):394 View
  61. Shalaby R, Vuong W, Hrabok M, Gusnowski A, Mrklas K, Li D, Snaterse M, Surood S, Cao B, Li X, Greiner R, Greenshaw A, Agyapong V. Gender Differences in Satisfaction With a Text Messaging Program (Text4Hope) and Anticipated Receptivity to Technology-Based Health Support During the COVID-19 Pandemic: Cross-sectional Survey Study. JMIR mHealth and uHealth 2021;9(4):e24184 View
  62. Baumel A, Muench F. Effort-Optimized Intervention Model: Framework for Building and Analyzing Digital Interventions That Require Minimal Effort for Health-Related Gains. Journal of Medical Internet Research 2021;23(3):e24905 View
  63. Rafiei R, Williams C, Jiang J, Aungst T, Durrer M, Tran D, Howald R. Digital Health Integration Assessment and Maturity of the United States Biopharmaceutical Industry: Forces Driving the Next Generation of Connected Autoinjectable Devices. JMIR mHealth and uHealth 2021;9(3):e25406 View
  64. Wasil A, Taylor M, Franzen R, Steinberg J, DeRubeis R. Promoting Graduate Student Mental Health During COVID-19: Acceptability, Feasibility, and Perceived Utility of an Online Single-Session Intervention. Frontiers in Psychology 2021;12 View
  65. Shi J, Lo B, Wong H, Hollenberg E, Sanches M, Abi-Jaoudé A, Chaim G, Cleverley K, Henderson J, Johnson A, Levinson A, Pham Q, Robb J, Voineskos A, Wiljer D. Assessing the usability and user engagement of Thought Spot - A digital mental health help-seeking solution for transition-aged youth. Internet Interventions 2021;24:100386 View
  66. Wong H, Lo B, Shi J, Hollenberg E, Abi-Jaoude A, Johnson A, Chaim G, Cleverley K, Henderson J, Levinson A, Robb J, Voineskos A, Wiljer D. Postsecondary Student Engagement With a Mental Health App and Online Platform (Thought Spot): Qualitative Study of User Experience. JMIR Mental Health 2021;8(4):e23447 View
  67. Roberts A, Davenport T, Wong T, Moon H, Hickie I, LaMonica H. Evaluating the quality and safety of health-related apps and e-tools: Adapting the Mobile App Rating Scale and developing a quality assurance protocol. Internet Interventions 2021;24:100379 View
  68. Poort H, Ryan A, MacDougall K, Malinowski P, MacDonald A, Markin Z, Pirl W, Greer J, Fasciano K. Feasibility and Acceptability of a Mobile Phone App Intervention for Coping With Cancer as a Young Adult: Pilot Trial and Thematic Analysis. Journal of Medical Internet Research 2021;23(6):e25069 View
  69. Bulaj G, Clark J, Ebrahimi M, Bald E. From Precision Metapharmacology to Patient Empowerment: Delivery of Self-Care Practices for Epilepsy, Pain, Depression and Cancer Using Digital Health Technologies. Frontiers in Pharmacology 2021;12 View
  70. Stenzel L, Röcken M, Borgmann S, Stoll O. Developing and Implementing an App-Based Blended Psychological Skills Training: A Case Study. The Sport Psychologist 2021;35(2):155 View
  71. Knapp A, Cohen K, Nicholas J, Mohr D, Carlo A, Skerl J, Lattie E. Integration of Digital Tools into Community Mental Health Care Settings that Serve Young People: Considerations from Clinicians (Preprint). JMIR Mental Health 2021 View
  72. Li J, Yu K, Bao X, Liu X, Yao J. Patterns of eHealth Website User Engagement Based on Cross-site Clickstream Data: Correlational Study. Journal of Medical Internet Research 2021;23(8):e29299 View
  73. Camacho E, Torous J. Introducing an implementation framework for augmenting care with digital technology for early psychosis patients: theory and motivation. Journal of Mental Health 2021:1 View
  74. Patoz M, Hidalgo-Mazzei D, Pereira B, Blanc O, de Chazeron I, Murru A, Verdolini N, Pacchiarotti I, Vieta E, Llorca P, Samalin L. Patients’ adherence to smartphone apps in the management of bipolar disorder: a systematic review. International Journal of Bipolar Disorders 2021;9(1) View
  75. Andrade A, Beleigoli A, Diniz M, Ribeiro A. Influence of Baseline User Characteristics and Early Use Patterns (24-Hour) on Long-Term Adherence and Effectiveness of a Web-Based Weight Loss Randomized Controlled Trial: Latent Profile Analysis. Journal of Medical Internet Research 2021;23(6):e26421 View
  76. McCall T, Ali M, Yu F, Fontelo P, Khairat S. Development of a Mobile App to Support Self-management of Anxiety and Depression in African American Women: Usability Study. JMIR Formative Research 2021;5(8):e24393 View
  77. Auriacombe M, Fournet L, Dupuy L, Micoulaud-Franchi J, de Sevin E, Moriceau S, Baillet E, Alexandre J, Serre F, Philip P. Effectiveness and Acceptance of a Smartphone-Based Virtual Agent Screening for Alcohol and Tobacco Problems and Associated Risk Factors During COVID-19 Pandemic in the General Population. Frontiers in Psychiatry 2021;12 View
  78. Smith A, Fowler L, Graham A, Jaworski B, Firebaugh M, Monterubio G, Vázquez M, DePietro B, Sadeh-Sharvit S, Balantekin K, Topooco N, Wilfley D, Taylor C, Fitzsimmons-Craft E. Digital Overload among College Students: Implications for Mental Health App Use. Social Sciences 2021;10(8):279 View
  79. Kittler C, Stenzel L, Jekauc D, Stoll O. Implementation of an App-Based Blended Mindfulness Intervention in a Bundesliga Youth Academy Targeting Goalkeepers: A Case Study. Case Studies in Sport and Exercise Psychology 2021;5(1):95 View
  80. Shih C, Pudipeddi R, Uthayakumar A, Washington P. Exploratory Feasibility Study of Quokka: A Local Community-Based Social Network for Mental Health and Wellbeing (Preprint). JMIRx Med 2020 View
  81. Anton M, Mochari-Greenberger H, Andreopoulos E, Pande R. Evaluation of a commercial mobile health app for depression and anxiety: A retrospective cohort study of AbleTo Digital+ Users (Preprint). JMIR Formative Research 2021 View
  82. Auf H, Dagman J, Renström S, Chaplin J. GAMIFICATION AND NUDGING TECHNIQUES FOR IMPROVING USER ENGAGEMENT IN MENTAL HEALTH AND WELL-BEING APPS. Proceedings of the Design Society 2021;1:1647 View
  83. Reyes A. The Process of Learning Mindfulness and Acceptance through the Use of a Mobile App Based on Acceptance and Commitment Therapy: A Grounded Theory Analysis. Issues in Mental Health Nursing 2021:1 View
  84. Lukic Y, Klein S, Brügger V, Keller O, Fleisch E, Kowatsch T. The Impact of a Gameful Breathing Training Visualization on Intrinsic Experiential Value, Perceived Effectiveness, and Engagement Intentions: Between-subject Online Experiment (Preprint). JMIR Serious Games 2021 View
  85. Lee M, Kang D, Kim S, Lim J, Yoon J, Kim Y, Shim S, Kang E, Ahn J, Cho J, Shin S, Oh D. Who is more likely to adopt and comply with the electronic patient-reported outcome measure (ePROM) mobile application? A real-world study with cancer patients undergoing active treatment. Supportive Care in Cancer 2021 View
  86. Garety P, Ward T, Emsley R, Greenwood K, Freeman D, Fowler D, Kuipers E, Bebbington P, Dunn G, Hardy A. Digitally supported CBT to reduce paranoia and improve reasoning for people with schizophrenia-spectrum psychosis: the SlowMo RCT. Efficacy and Mechanism Evaluation 2021;8(11):1 View

Books/Policy Documents

  1. Mason-Robbie V. Postdigital Humans. View
  2. Gamboa P, Quaresma C, Varandas R, Gamboa H. Technological Innovation for Applied AI Systems. View