This paper is in the following e-collection/theme issue:

Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (2145) Depression and Mood Disorders; Suicide Prevention (1703) Generative Language Models Including ChatGPT (725) Artificial Intelligence (2162) Chatbots and Conversational Agents (748)

Published on in Vol 27 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/67891, first published .
Competency of Large Language Models in Evaluating Appropriate Responses to Suicidal Ideation: Comparative Study

Competency of Large Language Models in Evaluating Appropriate Responses to Suicidal Ideation: Comparative Study

Competency of Large Language Models in Evaluating Appropriate Responses to Suicidal Ideation: Comparative Study

Authors of this article:

Ryan K McBain1, 2, 3 Author Orcid Image ;   Jonathan H Cantor4 Author Orcid Image ;   Li Ang Zhang4 Author Orcid Image ;   Olesya Baker3, 5 Author Orcid Image ;   Fang Zhang3, 5 Author Orcid Image ;   Alyssa Halbisen5 Author Orcid Image ;   Aaron Kofner1 Author Orcid Image ;   Joshua Breslau6 Author Orcid Image ;   Bradley Stein6 Author Orcid Image ;   Ateev Mehrotra7 Author Orcid Image ;   Hao Yu3, 5 Author Orcid Image
Article Authors Cited by (8) Tweetations (5) Metrics

Journals

  1. Bucher A, Egger S, Vashkite I, Wu W, Schwabe G. “It’s Not Only Attention We Need”: Systematic Review of Large Language Models in Mental Health Care. JMIR Mental Health 2025;12:e78410 View
  2. Fareed M, Fatima M, Uddin J, Ahmed A, Sattar M. A systematic review of ethical considerations of large language models in healthcare and medicine. Frontiers in Digital Health 2025;7 View
  3. Rousmaniere T, Goldberg S, Torous J. Large language models as mental health providers. The Lancet Psychiatry 2026;13(1):7 View
  4. Balan R, Gumpel T. ChatGPT Clinical Use in Mental Health Care: Scoping Review of Empirical Evidence. JMIR Mental Health 2025;12:e81204 View
  5. Dwyer B, Flathers M, Sano A, Dempsey A, Cipriani A, Gazi A, Hill B, Gorban C, Rodriguez C, Stromeyer C, King D, Rozenblit E, Strudwick G, Linardon J, Cheong J, Firth J, Herpertz J, Schwarz J, Truong K, Emerson M, Paulus M, Patriquin M, Hua Y, Choudhary S, Siddals S, Pinillos L, Bantjes J, Scheuller S, Xu X, Duckworth K, Gillison D, Wood M, Torous J. Mindbench.ai: an actionable platform to evaluate the profile and performance of large language models in a mental healthcare context. NPP—Digital Psychiatry and Neuroscience 2025;3(1) View
  6. Baggot M. The Quest for Connection in AI Companions. Journal of Ethics and Emerging Technologies 2025;35(1):1 View
  7. You Q, Luo Y, Chen Z, Song X, Wang F, Wen S, Ding Q, Chen J. How large language model responds to common depression questions: A comparative analysis of ChatGPT-4.0, DeepSeek, Google Gemini and Perplexity. Nurse Education in Practice 2026;90:104668 View
  8. Flathers M, Dwyer B, Rozenblit E, Torous J. Contextualizing Clinical Benchmarks: A Tripartite Approach to Evaluating LLM-Based Tools in Mental Health Settings. Journal of Psychiatric Practice 2025;31(6):294 View