This paper is in the following e-collection/theme issue:

Artificial Intelligence (2136) Chatbots and Conversational Agents (741) Generative Language Models Including ChatGPT (709) Clinical Information and Decision Making (1920) Natural Language Processing (917) Development and Evaluation of Research Methods, Instruments and Tools (746) Design, Usability, and Evaluation of Research Instruments, Scales, and Measures (85)

Published on in Vol 26 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/52399, first published .
Potential of Large Language Models in Health Care: Delphi Study

Potential of Large Language Models in Health Care: Delphi Study

Potential of Large Language Models in Health Care: Delphi Study

Authors of this article:

Kerstin Denecke1 Author Orcid Image ;   Richard May2 Author Orcid Image ;   LLMHealthGroup3 ;   Octavio Rivera Romero4, 5 Author Orcid Image
Article Authors Cited by (56) Tweetations (9) Metrics

Journals

  1. Denecke K, Reichenpfader D, Willi D, Kennel K, Bonel H, Nairz K, Cihoric N, Papaux D, von Tengg-Kobligk H. Person-based design and evaluation of MIA, a digital medical interview assistant for radiology. Frontiers in Artificial Intelligence 2024;7 View
  2. Reis F, Lenz C, Gossen M, Volk H, Drzeniek N. Practical Applications of Large Language Models for Health Care Professionals and Scientists. JMIR Medical Informatics 2024;12:e58478 View
  3. Mirzaei T, Amini L, Esmaeilzadeh P. Clinician voices on ethics of LLM integration in healthcare: a thematic analysis of ethical concerns and implications. BMC Medical Informatics and Decision Making 2024;24(1) View
  4. Wang B, Lai J, Cao H, Jin F, Li Q, Tang M, Yao C, Zhang P. Enhancing the interoperability and transparency of real-world data extraction in clinical research: evaluating the feasibility and impact of a ChatGLM implementation in Chinese hospital settings. European Heart Journal - Digital Health 2024;5(6):712 View
  5. Hasan S, Fury M, Woo J, Kunze K, Ramkumar P. Ethical Application of Generative Artificial Intelligence in Medicine. Arthroscopy: The Journal of Arthroscopic & Related Surgery 2025;41(4):874 View
  6. Sezgin E, Jackson D, Kocaballi A, Bibart M, Zupanec S, Landier W, Audino A, Ranalli M, Skeens M. Can Large Language Models Aid Caregivers of Pediatric Cancer Patients in Information Seeking? A Cross‐Sectional Investigation. Cancer Medicine 2025;14(1) View
  7. Gupta G, Singh A, Manikandan S, Ehtesham A. Digital Diagnostics: The Potential of Large Language Models in Recognizing Symptoms of Common Illnesses. AI 2025;6(1):13 View
  8. Gencer G, Gencer K. Large Language Models in Healthcare: A Bibliometric Analysis and Examination of Research Trends. Journal of Multidisciplinary Healthcare 2025;Volume 18:223 View
  9. Kataria S, Ravindran V. Bridging Health Inequity in Rheumatology With Technology. International Journal of Rheumatic Diseases 2025;28(1) View
  10. Idnay B, Xu Z, Adams W, Adibuzzaman M, Anderson N, Bahroos N, Bell D, Bumgardner C, Campion T, Castro M, Cimino J, Cohen I, Dorr D, Elkin P, Fan J, Ferris T, Foran D, Hanauer D, Hogarth M, Huang K, Kalpathy-Cramer J, Kandpal M, Karnik N, Katoch A, Lai A, Lambert C, Li L, Lindsell C, Liu J, Lu Z, Luo Y, McGarvey P, Mendonca E, Mirhaji P, Murphy S, Osborne J, Paschalidis I, Harris P, Prior F, Shaheen N, Shara N, Sim I, Tachinardi U, Waitman L, Wright R, Zai A, Zheng K, Lee S, Malin B, Natarajan K, Price II W, Zhang R, Zhang Y, Xu H, Bian J, Weng C, Peng Y. Environment scan of generative AI infrastructure for clinical and translational science. npj Health Systems 2025;2(1) View
  11. Yu A, Li A, Ahmed W, Saturno M, Cho S. Evaluating Artificial Intelligence in Spinal Cord Injury Management: A Comparative Analysis of ChatGPT-4o and Google Gemini Against American College of Surgeons Best Practices Guidelines for Spine Injury. Global Spine Journal 2025;15(7):3199 View
  12. Koss M, McLaughlin M, Switalla K, Falade I, Kim E. Exploring the role of ChatGPT in decision making for gender-affirming surgery. Artificial Intelligence Surgery 2025;5(1):116 View
  13. Lee J, Lee J, Yoo J. The role of large language models in the peer-review process: opportunities and challenges for medical journal reviewers and editors. Journal of Educational Evaluation for Health Professions 2025;22:4 View
  14. Rango D, Lorenzoni G, Silva H, Alves V, Gregori D. A Large Language Model-Based Approach for Coding Information from Free-Text Reported in Fall Risk Surveillance Systems: New Opportunities for In-Hospital Risk Management. Journal of Clinical Medicine 2025;14(5):1580 View
  15. Mondal H, Mondal S. The Role of Large Language Model Chatbots in Sexual Education: An Unmet Need of Research. Journal of Psychosexual Health 2025;7(2):120 View
  16. Delaunay J, Girbes D, Cusido J. Evaluating the Effectiveness of Large Language Models in Converting Clinical Data to FHIR Format. Applied Sciences 2025;15(6):3379 View
  17. Bolpagni M, Gabrielli S. Development of a Comprehensive Evaluation Scale for LLM-Powered Counseling Chatbots (CES-LCC) Using the eDelphi Method. Informatics 2025;12(1):33 View
  18. Shi Z, Long X, Yang X, Fan J, Tang J. The LEG program promotes the development of physical activity and fundamental movement skills in preschool children aged 3–6 years: a Delphi study. Frontiers in Public Health 2025;13 View
  19. Kwan H, Shell J, Fahy C, Yang S, Xing Y. Integrating Large Language Models into Medication Management in Remote Healthcare: Current Applications, Challenges, and Future Prospects. Systems 2025;13(4):281 View
  20. Jabal M, Warman P, Zhang J, Gupta K, Jain A, Mazurowski M, Wiggins W, Magudia K, Calabrese E. Open-Weight Language Models and Retrieval-Augmented Generation for Automated Structured Data Extraction from Diagnostic Reports: Assessment of Approaches and Parameters. Radiology: Artificial Intelligence 2025;7(3) View
  21. Du K, Li A, Zuo Q, Zhang C, Guo R, Chen P, Du W, Li S. Comparing Artificial Intelligence–Generated and Clinician-Created Personalized Self-Management Guidance for Patients With Knee Osteoarthritis: Blinded Observational Study. Journal of Medical Internet Research 2025;27:e67830 View
  22. Qiang S, Zhang H, Liao Y, Zhang Y, Gu Y, Wang Y, Xu Z, Shi H, Han N, Yu H. Application of Large Language Models in Stroke Rehabilitation Health Education: 2-Phase Study. Journal of Medical Internet Research 2025;27:e73226 View
  23. Tan D, Huang Y, Liu M, Li Z, Wu X, Huang C. Identification of Online Health Information Using Large Pretrained Language Models: Mixed Methods Study. Journal of Medical Internet Research 2025;27:e70733 View
  24. Almusallam N, Hasnain M. The Role of ChatGPT in Reducing Storage, Energy, and Scalability Overheads in Blockchain‐Based Healthcare Systems. Transactions on Emerging Telecommunications Technologies 2025;36(5) View
  25. Sul A, Kim S. Consensus on the Potential of Large Language Models in Healthcare: Insights from a Delphi Survey in Korea. Healthcare Informatics Research 2025;31(2):146 View
  26. Borgonovo F, Matsuo T, Petri F, Amin Alavi S, Mazudie Ndjonko L, Gori A, Berbari E. Battle of the Bots: Solving Clinical Cases in Osteoarticular Infections With Large Language Models. Mayo Clinic Proceedings: Digital Health 2025;3(3):100230 View
  27. Rust P, Frings J, Meister S, Fehring L. Evaluation of a large language model to simplify discharge summaries and provide cardiological lifestyle recommendations. Communications Medicine 2025;5(1) View
  28. Adugna A, Abebaw D, Abebaw A, Jemal M. Deep learning architectures for influenza dynamics and treatment optimization: a comprehensive review. Frontiers in Artificial Intelligence 2025;8 View
  29. Shakhbazau A. Fine-tuning LLM hyperparameters to align semantic and physiological contexts of aging-related pathways. Molecular Diversity 2025 View
  30. Ramjee P, Sachdeva B, Golechha S, Kulkarni S, Fulari G, Murali K, Jain M. CataractBot: An LLM-powered Expert-in-the-Loop Chatbot for Cataract Patients. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2025;9(2):1 View
  31. Denecke K, Rivera Romero O, Wynn R, Gabarron E. Persuasive chatbot-based interventions for depression: a list of recommendations for improving reporting standards. Frontiers in Psychiatry 2025;16 View
  32. Chow J, Li K. Large Language Models in Medical Chatbots: Opportunities, Challenges, and the Need to Address AI Risks. Information 2025;16(7):549 View
  33. Templin T, Fort S, Padmanabham P, Seshadri P, Rimal R, Oliva J, Hassmiller Lich K, Sylvia S, Sinnott-Armstrong N. Framework for bias evaluation in large language models in healthcare settings. npj Digital Medicine 2025;8(1) View
  34. Park C, An M, Hwang G, Park R, An J. Clinical Performance and Communication Skills of ChatGPT Versus Physicians in Emergency Medicine: Simulated Patient Study. JMIR Medical Informatics 2025;13:e68409 View
  35. Wang Y, Tian L, Meng J, Zhang J, Nie Z, Wei W, Ding D, Tang X, Zhang Q, He Y. Evaluation of large language models in patient education and clinical decision support for rotator cuff injury: a two-phase benchmarking study. BMC Medical Informatics and Decision Making 2025;25(1) View
  36. Santamaria T. A Survey of Practical Tools in Clinical Practice—A Survey of What Is in Use or Soon to be at Use in Clinical Practice. Primary Care: Clinics in Office Practice 2025;52(4):745 View
  37. Tabernée Heijtmeijer S, Nicolai N, Janssen N, Kortes J, Pinkster R, Puladi B, Rashad A, Vladu O, Pijpker P, Witjes M, Pichardo S, Kraeima J. Measuring patient satisfaction with education using extended reality in orthognathic surgery: Development, validation, and reliability of the 3D orthognathic surgery questionnaire (3DOS-Q). PEC Innovation 2025;7:100429 View
  38. Nagarajan R, Klotzman V, Kondo M, Godambe S, Gold A, Henderson J, Martel S. Taxonomy Portraits: Deciphering the Hierarchical Relationships of Medical Large Language Models. JMIR Medical Informatics 2025;13:e72918 View
  39. Wong G, Chung K. Natural Language Processing and Large Language Models. Hand Clinics 2026;42(1):27 View
  40. Shah R, Jotterand F. Large Language Models in Neurology Treatment Decision-Making: a Scoping Review. Journal of Medical Systems 2025;49(1) View
  41. Fahrni G, Rotzinger D. Expanding on “A Hitchhiker’s Guide to Good Prompting Practices for Large Language Models in Radiology”. Journal of the American College of Radiology 2025;22(11):1258 View
  42. Grambow S, Desai M, Weinfurt K, Lindsell C, Pencina M, Rende L, Pomann G. Integrating large language models in biostatistical workflows for clinical and translational research. Journal of Clinical and Translational Science 2025;9(1) View
  43. Sheth U, Lo M, McCarthy J, Baath N, Last N, Guo E, Monteiro S, Sibbald M. Understanding the Role of Large Language Model Virtual Patients in Developing Communication and Clinical Skills in Undergraduate Medical Education. International Medical Education 2025;4(4):39 View
  44. Vladic N, Nopp S, Pabinger I, Ageno W, Connors J, Eichinger S, Ay C. Large language models vs thrombosis experts: a comparative study on patient education and clinical decision-making in venous thromboembolism. Journal of Thrombosis and Haemostasis 2025 View
  45. Yildiz Y, Nenadic G, Jani M, Jenkins D. Will large language models transform clinical prediction?. Diagnostic and Prognostic Research 2025;9(1) View
  46. Ghorbian M, Ghobaei-Arani M. A comprehensive review of LLM applications for lung cancer diagnosis and treatment: classification, challenges, and future directions. Journal of Big Data 2025;12(1) View
  47. Nuccetelli F, Gabellone V, Marsano F, Giovanetti F, Dri P, Valetto M, Prato R. The use of artificial intelligence in healthcare as perceived by the citizens and patients: a narrative review of the literature. European Journal of Public Health 2025 View
  48. Sachdeva B, Ramjee P, Sharma R, Thulasidas M, Raveendra Murthy S, Fulari G, Murali K, Jain M. Utility of an LLM-powered experts-in-the-loop chatbot for pre- and post-operative care of cataract surgery patients. European Journal of Ophthalmology 2025 View

Books/Policy Documents

  1. Bolpagni M, De Carli S, Sanna L, Gabrielli S, Dragoni M. Artificial Intelligence in Medicine. View
  2. Weimann T, Schlieter H, Weimann A, Ziemssen T. Digitale Patientenkommunikation. View

Conference Proceedings

  1. Xu M, Ye C, Zeng Z, Chang C, Qi S, Wu Y, Yang H, Chen Y, Huang H, Liu L, Cao Z, Deng X. 2024 IEEE International Conference on Digital Health (ICDH). Adopting Generative AI with Precaution in Dentistry: A Review and Reflection View
  2. Singh H, Bajetha I, Bharti , Pandey A, Singh S, Singh S. 2024 International Conference on Progressive Innovations in Intelligent Systems and Data Science (ICPIDS). From Text to Treatment: Large Language Models in Clinical Practice and Medical Research View
  3. Kaushik P, Rawat P, Rao B, Najeem M, Bishnoi M, Kaliappan S. 2025 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI). Women’s Health Recommendation System using Large Language Models View
  4. Pilato G, Persia F, D'Auria D. 2025 19th International Conference on Semantic Computing (ICSC). Issues and Perspectives on Integrating a Healthcare Monitoring Tool with an LLM Module View
  5. Kumar M R, G L S, S S. 2025 Third International Conference on Augmented Intelligence and Sustainable Systems (ICAISS). MedHub – LLM-based Healthcare System View
  6. Bouchekir R, Faghih F, Beyene T. 2025 55th Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W). Hallucination Detection in LLMs via Beam Search Sampling and Semantic Consistency Analysis View