This paper is in the following e-collection/theme issue:

Generative Language Models Including ChatGPT (497) Artificial Intelligence (1735) Clinical Information and Decision Making (1655) Chatbots and Conversational Agents (632) Decision Support for Health Professionals (1338)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/48659, first published .
Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study

Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study

Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study

Authors of this article:

Arya Rao1, 2, 3 Author Orcid Image ;   Michael Pang1, 2, 3 Author Orcid Image ;   John Kim1, 2, 3 Author Orcid Image ;   Meghana Kamineni1, 2, 3 Author Orcid Image ;   Winston Lie1, 2, 3 Author Orcid Image ;   Anoop K Prasad1, 2, 3 Author Orcid Image ;   Adam Landman2, 4 Author Orcid Image ;   Keith Dreyer2, 5 Author Orcid Image ;   Marc D Succi1, 2, 3, 6 Author Orcid Image
Article Authors Cited by (153) Tweetations (29) Metrics

Journals

  1. El Haj M, Boutoleau-Bretonnière C, Chapelet G. ChatGPT's dance with neuropsychological data: A case study in Alzheimer’s disease. Ageing Research Reviews 2023;92:102117 View
  2. Benedicenti F, Pessarelli T, Corradi M, Michelon M, Nandi N, Lampertico P, Vecchi M, Scaramella L, Elli L. Mirror, mirror on the wall, who is the best of them all? Artificial intelligence versus gastroenterologists in solving clinical problems. Gastroenterology Report 2022;11 View
  3. Weiner S, Wakeman S. Stigma in Large Language Models: A Chatbot Responds. Journal of Addiction Medicine 2024;18(1):90 View
  4. Liu J, Liu F, Fang J, Liu S. The application of Chat Generative Pre-trained Transformer in nursing education. Nursing Outlook 2023;71(6):102064 View
  5. Griewing S, Gremke N, Wagner U, Lingenfelder M, Kuhn S, Boekhoff J. Challenging ChatGPT 3.5 in Senology—An Assessment of Concordance with Breast Cancer Tumor Board Decision Making. Journal of Personalized Medicine 2023;13(10):1502 View
  6. Bushuven S, Bentele M, Bentele S, Gerber B, Bansbach J, Ganter J, Trifunovic-Koenig M, Ranisch R. “ChatGPT, Can You Help Me Save My Child’s Life?” - Diagnostic Accuracy and Supportive Capabilities to Lay Rescuers by ChatGPT in Prehospital Basic Life Support and Paediatric Advanced Life Support Cases – An In-silico Analysis. Journal of Medical Systems 2023;47(1) View
  7. Guillen-Grima F, Guillen-Aguinaga S, Guillen-Aguinaga L, Alas-Brun R, Onambele L, Ortega W, Montejo R, Aguinaga-Ontoso E, Barach P, Aguinaga-Ontoso I. Evaluating the Efficacy of ChatGPT in Navigating the Spanish Medical Residency Entrance Examination (MIR): Promising Horizons for AI in Clinical Medicine. Clinics and Practice 2023;13(6):1460 View
  8. Li J. Security Implications of AI Chatbots in Health Care. Journal of Medical Internet Research 2023;25:e47551 View
  9. Maursetter L. Will ChatGPT Be the Next Nephrologist?. Clinical Journal of the American Society of Nephrology 2024;19(1):2 View
  10. Chen J, Liu L, Ruan S, Li M, Yin C. Are Different Versions of ChatGPT’s Ability Comparable to the Clinical Diagnosis Presented in Case Reports? A Descriptive Study. Journal of Multidisciplinary Healthcare 2023;Volume 16:3825 View
  11. Zawiah M, Al-Ashwal F, Gharaibeh L, Abu Farha R, Alzoubi K, Abu Hammour K, Qasim Q, Abrah F. ChatGPT and Clinical Training: Perception, Concerns, and Practice of Pharm-D Students. Journal of Multidisciplinary Healthcare 2023;Volume 16:4099 View
  12. Alotaibi S, Rehman A, Hasnain M. Revolutionizing ocular cancer management: a narrative review on exploring the potential role of ChatGPT. Frontiers in Public Health 2023;11 View
  13. Non L. All aboard the ChatGPT steamroller: Top 10 ways to make artificial intelligence work for healthcare professionals. Antimicrobial Stewardship & Healthcare Epidemiology 2023;3(1) View
  14. Ćirković A, Katz T. Exploring the Potential of ChatGPT-4 in Predicting Refractive Surgery Categorizations: Comparative Study. JMIR Formative Research 2023;7:e51798 View
  15. Sezgin E. Redefining Virtual Assistants in Health Care: The Future With Large Language Models. Journal of Medical Internet Research 2024;26:e53225 View
  16. Piryani R, Piryani S, Piryani R. Medical schools of South Asian countries need to incorporate artificial intelligence-powered chatbots in existing undergraduate medical curricula. Journal of Integrative Medicine and Public Health 2023;2(2):37 View
  17. Sallam M, Barakat M, Sallam M. A Preliminary Checklist (METRICS) to Standardize the Design and Reporting of Studies on Generative Artificial Intelligence–Based Models in Health Care Education and Practice: Development Study Involving a Literature Review. Interactive Journal of Medical Research 2024;13:e54704 View
  18. Andrew A. Potential applications and implications of large language models in primary care. Family Medicine and Community Health 2024;12(Suppl 1):e002602 View
  19. Robleto E, Habashi A, Kaplan M, Riley R, Zhang C, Bianchi L, Shehadeh L. Medical students’ perceptions of an artificial intelligence (AI) assisted diagnosing program. Medical Teacher 2024;46(9):1180 View
  20. Yu J, Matava C. ChatGPT for Parents of Children Seeking Emergency Care – so much Hope, so much Caution. Journal of Medical Systems 2024;48(1) View
  21. Arslan B, Eyupoglu G, Korkut S, Turkdogan K, Altinbilek E. The accuracy of AI-assisted chatbots on the annual assessment test for emergency medicine residents. Journal of Medicine, Surgery, and Public Health 2024;3:100070 View
  22. Teixeira-Marques F, Medeiros N, Nazaré F, Alves S, Lima N, Ribeiro L, Gama R, Oliveira P. Exploring the role of ChatGPT in clinical decision-making in otorhinolaryngology: a ChatGPT designed study. European Archives of Oto-Rhino-Laryngology 2024;281(4):2023 View
  23. Milad D, Antaki F, Milad J, Farah A, Khairy T, Mikhail D, Giguère C, Touma S, Bernstein A, Szigiato A, Nayman T, Mullie G, Duval R. Assessing the medical reasoning skills of GPT-4 in complex ophthalmology cases. British Journal of Ophthalmology 2024;108(10):1398 View
  24. Rudroff T. Revealing the Complexity of Fatigue: A Review of the Persistent Challenges and Promises of Artificial Intelligence. Brain Sciences 2024;14(2):186 View
  25. Ward M, Unadkat P, Toscano D, Kashanian A, Lynch D, Horn A, D'Amico R, Mittler M, Baum G. A Quantitative Assessment of ChatGPT as a Neurosurgical Triaging Tool. Neurosurgery 2024;95(2):487 View
  26. Liu D, Mazurek M, Whitehead D, Hood M, Choi P, Gupte A, Ottensmeyer M, Fintelmann F, Uppot R, Andriole K, Gee M, Brink J, Succi M. A Novel Design-Thinking, Hospital Innovation Core Certificate Curriculum for Radiologists and Trainees: Creation, Implementation, and Multiyear Results. Academic Radiology 2024;31(2):417 View
  27. Moreno A, Bitterman D. Toward Clinical-Grade Evaluation of Large Language Models. International Journal of Radiation Oncology*Biology*Physics 2024;118(4):916 View
  28. Lim A, Nicolaides A. Becoming-with-AI: Rethinking Professional Knowledge Through Generative Knowing. Reflective Practice 2024;25(3):391 View
  29. Burns J, Gichoya J, Kohli M, Jones J, Purkayastha S, Liang H. Theory of radiologist interaction with instant messaging decision support tools: A sequential-explanatory study. PLOS Digital Health 2024;3(2):e0000297 View
  30. Ghanem Y, Rouhi A, Al-Houssan A, Saleh Z, Moccia M, Joshi H, Dumon K, Hong Y, Spitz F, Joshi A, Kwiatt M. Dr. Google to Dr. ChatGPT: assessing the content and quality of artificial intelligence-generated medical information on appendicitis. Surgical Endoscopy 2024;38(5):2887 View
  31. Al Tibi G, Alexander M, Miller S, Chronos N. A Retrospective Comparison of Medication Recommendations Between a Cardiologist and ChatGPT-4 for Hypertension Patients in a Rural Clinic. Cureus 2024 View
  32. Beaulieu-Jones B, Berrigan M, Shah S, Marwaha J, Lai S, Brat G. Evaluating capabilities of large language models: Performance of GPT-4 on surgical knowledge assessments. Surgery 2024;175(4):936 View
  33. Sebo P. What Is the Performance of ChatGPT in Determining the Gender of Individuals Based on Their First and Last Names?. JMIR AI 2024;3:e53656 View
  34. El Haj M, Boutoleau-Bretonnière C, Gallouj K, Wagemann N, Antoine P, Kapogiannis D, Chapelet G. ChatGPT as a Diagnostic Aid in Alzheimer’s Disease: An Exploratory Study. Journal of Alzheimer's Disease Reports 2024;8(1):495 View
  35. Alexopoulos G. Artificial Intelligence and the Sense of Self of Older Adults: A Philosophy of Science Perspective. The American Journal of Geriatric Psychiatry 2024;32(6):657 View
  36. Warrier A, Singh R, Haleem A, Zaki H, Eloy J. The Comparative Diagnostic Capability of Large Language Models in Otolaryngology. The Laryngoscope 2024;134(9):3997 View
  37. Spotnitz M, Idnay B, Gordon E, Shyu R, Zhang G, Liu C, Cimino J, Weng C. A Survey of Clinicians' Views of the Utility of Large Language Models. Applied Clinical Informatics 2024;15(02):306 View
  38. Rosselló-Jiménez D, Docampo S, Collado Y, Cuadra-Llopart L, Riba F, Llonch-Masriera M. Geriatrics and artificial intelligence in Spain (Ger-IA project): talking to ChatGPT, a nationwide survey. European Geriatric Medicine 2024;15(4):1129 View
  39. Turan E, Baydemir A, Özcan F, Şahin A. Evaluating the accuracy of ChatGPT-4 in predicting ASA scores: A prospective multicentric study ChatGPT-4 in ASA score prediction. Journal of Clinical Anesthesia 2024;96:111475 View
  40. Quttainah M, Mishra V, Madakam S, Lurie Y, Mark S. Cost, Usability, Credibility, Fairness, Accountability, Transparency, and Explainability Framework for Safe and Effective Large Language Models in Medical Education: Narrative Review and Qualitative Study. JMIR AI 2024;3:e51834 View
  41. Rojas A. An Investigation into ChatGPT’s Application for a Scientific Writing Assignment. Journal of Chemical Education 2024;101(5):1959 View
  42. Vaira L, Lechien J, Abbate V, Allevi F, Audino G, Beltramini G, Bergonzani M, Boscolo-Rizzo P, Califano G, Cammaroto G, Chiesa-Estomba C, Committeri U, Crimi S, Curran N, di Bello F, di Stadio A, Frosolini A, Gabriele G, Gengler I, Lonardi F, Maglitto F, Mayo-Yáñez M, Petrocelli M, Pucci R, Saibene A, Saponaro G, Tel A, Trabalzini F, Trecca E, Vellone V, Salzano G, De Riu G. Validation of the Quality Analysis of Medical Artificial Intelligence (QAMAI) tool: a new tool to assess the quality of health information provided by AI platforms. European Archives of Oto-Rhino-Laryngology 2024;281(11):6123 View
  43. Chiu W, Ko W, Cho W, Hui S, Chan W, Kuo M. Evaluating the Diagnostic Performance of Large Language Models on Complex Multimodal Medical Cases. Journal of Medical Internet Research 2024;26:e53724 View
  44. Scott I, Zuccon G. The new paradigm in machine learning – foundation models, large language models and beyond: a primer for physicians. Internal Medicine Journal 2024;54(5):705 View
  45. Shikino K, Shimizu T, Otsuka Y, Tago M, Takahashi H, Watari T, Sasaki Y, Iizuka G, Tamura H, Nakashima K, Kunitomo K, Suzuki M, Aoyama S, Kosaka S, Kawahigashi T, Matsumoto T, Orihara F, Morikawa T, Nishizawa T, Hoshina Y, Yamamoto Y, Matsuo Y, Unoki Y, Kimura H, Tokushima M, Watanuki S, Saito T, Otsuka F, Tokuda Y. Evaluation of ChatGPT-Generated Differential Diagnosis for Common Diseases With Atypical Presentation: Descriptive Research. JMIR Medical Education 2024;10:e58758 View
  46. Buldur M, Sezer B. Evaluating the accuracy of Chat Generative Pre-trained Transformer version 4 (ChatGPT-4) responses to United States Food and Drug Administration (FDA) frequently asked questions about dental amalgam. BMC Oral Health 2024;24(1) View
  47. Kaneda Y, Tayuinosho A, Tomoyose R, Takita M, Hamaki T, Tanimoto T, Ozaki A. Evaluating ChatGPT's effectiveness and tendencies in Japanese internal medicine. Journal of Evaluation in Clinical Practice 2024;30(6):1017 View
  48. Petrella R. The AI Future of Emergency Medicine. Annals of Emergency Medicine 2024;84(2):139 View
  49. MEKOV Е, YAMAKOVA Y, KHAIRALLAH R, PETKOV R. ChatGPT in medical practice: what we could, what we should, and what we would. Gazzetta Medica Italiana Archivio per le Scienze Mediche 2024;183(3) View
  50. Nasef H, Patel H, Amin Q, Baum S, Ratnasekera A, Ang D, Havron W, Nakayama D, Elkbuli A. Evaluating the Accuracy, Comprehensiveness, and Validity of ChatGPT Compared to Evidence-Based Sources Regarding Common Surgical Conditions: Surgeons’ Perspectives. The American Surgeon™ 2025;91(3):325 View
  51. Munir F, Gehres A, Wai D, Song L. Evaluation of ChatGPT as a Tool for Answering Clinical Questions in Pharmacy Practice. Journal of Pharmacy Practice 2024;37(6):1303 View
  52. Griewing S, Knitza J, Boekhoff J, Hillen C, Lechner F, Wagner U, Wallwiener M, Kuhn S. Evolution of publicly available large language models for complex decision-making in breast cancer care. Archives of Gynecology and Obstetrics 2024;310(1):537 View
  53. Harada Y, Suzuki T, Harada T, Sakamoto T, Ishizuka K, Miyagami T, Kawamura R, Kunitomo K, Nagano H, Shimizu T, Watari T. Performance evaluation of ChatGPT in detecting diagnostic errors and their contributing factors: an analysis of 545 case reports of diagnostic errors. BMJ Open Quality 2024;13(2):e002654 View
  54. Li J, Tang T, Wu E, Zhao J, Zong H, Wu R, Feng W, Zhang K, Wang D, Qin Y, Shen Z, Qin Y, Ren S, Zhan C, Yang L, Wei Q, Shen B. RARPKB: a knowledge-guide decision support platform for personalized robot-assisted surgery in prostate cancer. International Journal of Surgery 2024;110(6):3412 View
  55. Aljamaan F, Temsah M, Altamimi I, Al-Eyadhy A, Jamal A, Alhasan K, Mesallam T, Farahat M, Malki K. Reference Hallucination Score for Medical Artificial Intelligence Chatbots: Development and Usability Study. JMIR Medical Informatics 2024;12:e54345 View
  56. Xu J, Lu L, Peng X, Pang J, Ding J, Yang L, Song H, Li K, Sun X, Zhang S. Data Set and Benchmark (MedGPTEval) to Evaluate Responses From Large Language Models in Medicine: Evaluation Development and Validation. JMIR Medical Informatics 2024;12:e57674 View
  57. . Einsatz von Künstlicher Intelligenz in der Notaufnahme. Notaufnahme up2date 2024;06(03):215 View
  58. Lucas M, Yang J, Pomeroy J, Yang C. Reasoning with large language models for medical question answering. Journal of the American Medical Informatics Association 2024;31(9):1964 View
  59. Deiner M, Honcharov V, Li J, Mackey T, Porco T, Sarkar U. Large Language Models Can Enable Inductive Thematic Analysis of a Social Media Corpus in a Single Prompt: Human Validation Study. JMIR Infodemiology 2024;4:e59641 View
  60. Muntean G, Marginean A, Groza A, Damian I, Roman S, Hapca M, Sere A, Mănoiu R, Muntean M, Nicoară S. A Qualitative Evaluation of ChatGPT4 and PaLM2’s Response to Patient’s Questions Regarding Age-Related Macular Degeneration. Diagnostics 2024;14(14):1468 View
  61. Hirosawa T, Shimizu T. The potential, limitations, and future of diagnostics enhanced by generative artificial intelligence. Diagnosis 2024;11(4):446 View
  62. Luo M, Pang J, Bi S, Lai Y, Zhao J, Shang Y, Cui T, Yang Y, Lin Z, Zhao L, Wu X, Lin D, Chen J, Lin H. Development and Evaluation of a Retrieval-Augmented Large Language Model Framework for Ophthalmology. JAMA Ophthalmology 2024;142(9):798 View
  63. Díaz-Flores García V, Freire Y, Tortosa M, Tejedor B, Estevez R, Suárez A. Google Gemini’s Performance in Endodontics: A Study on Answer Precision and Reliability. Applied Sciences 2024;14(15):6390 View
  64. Abou Karam G. Revolutionizing Medical Education: ChatGPT3.5 Ability to Behave as a Virtual Patient. Medical Science Educator 2024;34(6):1559 View
  65. Sezgin E, Sirrianni J, Kranz K. Evaluation of a Digital Scribe: Conversation Summarization for Emergency Department Consultation Calls. Applied Clinical Informatics 2024;15(03):600 View
  66. Ojeda Meixueiro V, Pérez-Campos Mayoral L, Hernández Huerta M, Matias-Cervantes C, Pérez Campos Mayoral E, Cruz Parada E, Pérez-Campos E. Relevance of a Customized Version of ChatGPT Explaining Laboratory Test Results in Patient Education. Journal of Medical Education and Curricular Development 2024;11 View
  67. Pavlik E, Ramaiah D, Rives T, Swiecki-Sikora A, Land J. Replies to Queries in Gynecologic Oncology by Bard, Bing and the Google Assistant. BioMedInformatics 2024;4(3):1773 View
  68. Geipel J, Jordan A. Der Einbezug von ChatGPT in die musiktherapeutische Praxis: ein Selbstversuch. Musiktherapeutische Umschau 2024;45(2):160 View
  69. Ramasubramanian S, Balaji S, Kannan T, Jeyaraman N, Sharma S, Migliorini F, Balasubramaniam S, Jeyaraman M. Comparative evaluation of artificial intelligence systems' accuracy in providing medical drug dosages: A methodological study. World Journal of Methodology 2024;14(4) View
  70. Sterling N, Brann F, Frisch S, Schrager J. Patient-Readable Radiology Report Summaries Generated via Large Language Model: Safety and Quality. Journal of Patient Experience 2024;11 View
  71. Liu C, Wei M, Qin Y, Zhang M, Jiang H, Xu J, Zhang Y, Hua Q, Hou Y, Dong Y, Xia S, Li N, Zhou J. Harnessing Large Language Models for Structured Reporting in Breast Ultrasound: A Comparative Study of Open AI (GPT-4.0) and Microsoft Bing (GPT-4). Ultrasound in Medicine & Biology 2024;50(11):1697 View
  72. Nechay T, Sazhin A, Loban K, Bogomolova A, Suglob V, Beniia T. Efficacy and safety of artificial intelligence-based large language models for decision making support in herniology: evaluation by experts and general surgeons. Pirogov Russian Journal of Surgery 2024;(8):6 View
  73. Chen J, Reddy A, Al-Sharif E, Shoji M, Kalaw F, Eslani M, Lang P, Arya M, Koretz Z, Bolo K, Arnett J, Roginiel A, Do J, Robbins S, Camp A, Scott N, Rudell J, Weinreb R, Baxter S, Granet D. Analysis of ChatGPT Responses to Ophthalmic Cases: Can ChatGPT Think like an Ophthalmologist?. Ophthalmology Science 2025;5(1):100600 View
  74. Davis N, El-Said E, Fortune P, Shen A, Succi M. Transforming Health Care Landscapes: The Lever of Radiology Research and Innovation on Emerging Markets Poised for Aggressive Growth. Journal of the American College of Radiology 2024;21(10):1552 View
  75. Afanasieva T, Platov P, Komolov A, Kuzlyakin A. Leveraging ChatGPT and Long Short-Term Memory in Recommender Algorithm for Self-Management of Cardiovascular Risk Factors. Mathematics 2024;12(16):2582 View
  76. Zhang C, Chen X. Letter to the editor, “Evaluating the accuracy of ChatGPT-4 in predicting ASA scores: A prospective multicentric study ChatGPT-4 in ASA score prediction”. Journal of Clinical Anesthesia 2024;98:111571 View
  77. Liu J, Liang X, Fang D, Zheng J, Yin C, Xie H, Li Y, Sun X, Tong Y, Che H, Hu P, Yang F, Wang B, Chen Y, Cheng G, Zhang J. The Diagnostic Ability of GPT-3.5 and GPT-4.0 in Surgery: Comparative Analysis. Journal of Medical Internet Research 2024;26:e54985 View
  78. Chen S, Kuo H, Chang S. Perceptions of ChatGPT in healthcare: usefulness, trust, and risk. Frontiers in Public Health 2024;12 View
  79. Young C, Enichen E, Rivera C, Auger C, Grant N, Rao A, Succi M. Diagnostic Accuracy of a Custom Large Language Model on Rare Pediatric Disease Case Reports. American Journal of Medical Genetics Part A 2025;197(2) View
  80. Sina E, Campbell D, Duffy A, Mandloi S, Benedict P, Farquhar D, Unsal A, Nyquist G. Evaluating ChatGPT as a Patient Education Tool for COVID‐19‐Induced Olfactory Dysfunction. OTO Open 2024;8(3) View
  81. Guirguis P, Youssef M, Punreddy A, Botros M, Raiford M, McDowell S. Is Information About Musculoskeletal Malignancies From Large Language Models or Web Resources at a Suitable Reading Level for Patients?. Clinical Orthopaedics & Related Research 2025;483(2):306 View
  82. Urom C, Grey B, Lindinger‐Sternart S, Lucey S. The new wave: Integrating artificial intelligence into ethical and multicultural counselling. Counselling and Psychotherapy Research 2025;25(1) View
  83. Hu J, Fu J, Zhao W, Lou P, Feng M, Ren H, Feng S, Li Y, Fang A. Characterizing pituitary adenomas in clinical notes: Corpus construction and its application in LLMs. Health Informatics Journal 2024;30(4) View
  84. Zhou P, Liang C, Xie Y, Yan J, Zhao S, Jiang L. The impact of ChatGPT’s competencies on users’ intention to use. The Service Industries Journal 2024:1 View
  85. Reading Turchioe M, Kisselev S, Van Bulck L, Bakken S. Increasing Generative Artificial Intelligence Competency among Students Enrolled in Doctoral Nursing Research Coursework. Applied Clinical Informatics 2024;15(05):842 View
  86. Nguyen D, Rao A, Mazumder A, Succi M. Exploring the accuracy of embedded ChatGPT-4 and ChatGPT-4o in generating BI-RADS scores: a pilot study in radiologic clinical support. Clinical Imaging 2025;117:110335 View
  87. Dagli M, Ghenbot Y, Ahmad H, Chauhan D, Turlip R, Wang P, Welch W, Ozturk A, Yoon J. Development and validation of a novel AI framework using NLP with LLM integration for relevant clinical data extraction through automated chart review. Scientific Reports 2024;14(1) View
  88. Sudri K, Motro-Feingold I, Ramon-Gonen R, Barda N, Klang E, Fefer P, Amunts S, Attia Z, Alkhouli M, Segev A, Cohen-Shelly M, Barbash I. Enhancing Coronary Revascularization Decisions: The Promising Role of Large Language Models as a Decision-Support Tool for Multidisciplinary Heart Team. Circulation: Cardiovascular Interventions 2024;17(11):e014201 View
  89. Wu W, Guo Y, Li Q, Jia C. Exploring the potential of large language models in identifying metabolic dysfunction‐associated steatotic liver disease: A comparative study of non‐invasive tests and artificial intelligence‐generated responses. Liver International 2025;45(4) View
  90. Mohammad R, Alkhnbashi O, Hammoudeh M. Optimizing Large Language Models for Arabic Healthcare Communication: A Focus on Patient-Centered NLP Applications. Big Data and Cognitive Computing 2024;8(11):157 View
  91. Kovari A. AI for Decision Support: Balancing Accuracy, Transparency, and Trust Across Sectors. Information 2024;15(11):725 View
  92. Shojaei P, Khosravi M, Jafari Y, Mahmoudi A, Hassanipourmahani H. ChatGPT utilization within the building blocks of the healthcare services: A mixed-methods study. DIGITAL HEALTH 2024;10 View
  93. Drouaud A, Stocchi C, Tang J, Gonsalves G, Cheung Z, Szatkowski J, Forsh D. Exploring the Performance of ChatGPT in an Orthopaedic Setting and Its Potential Use as an Educational Tool. JBJS Open Access 2024;9(4) View
  94. Ho C, Tian T, Ayers A, Aaron R, Phillips V, Wolf R, Mathioudakis N, Dai T, Klonoff D. Qualitative metrics from the biomedical literature for evaluating large language models in clinical decision-making: a narrative review. BMC Medical Informatics and Decision Making 2024;24(1) View
  95. Brügge E, Ricchizzi S, Arenbeck M, Keller M, Schur L, Stummer W, Holling M, Lu M, Darici D. Large language models improve clinical decision making of medical students through patient simulation and structured feedback: a randomized controlled trial. BMC Medical Education 2024;24(1) View
  96. Lee J, Park S, Shin J, Cho B. Analyzing evaluation methods for large language models in the medical field: a scoping review. BMC Medical Informatics and Decision Making 2024;24(1) View
  97. Cooperman S, Brandão R. Integrating domain-specific resources: Advancing AI for foot and ankle surgery. Foot & Ankle Surgery: Techniques, Reports & Cases 2025;5(1):100445 View
  98. El Gharib K, Jundi B, Furfaro D, Abdulnour R. AI-assisted human clinical reasoning in the ICU: beyond “to err is human”. Frontiers in Artificial Intelligence 2024;7 View
  99. Jin H, Kim E. Performance of GPT-3.5 and GPT-4 on the Korean Pharmacist Licensing Examination: Comparison Study. JMIR Medical Education 2024;10:e57451 View
  100. Hasan S, Fury M, Woo J, Kunze K, Ramkumar P. Ethical Application of Generative Artificial Intelligence in Medicine. Arthroscopy: The Journal of Arthroscopic & Related Surgery 2025;41(4):874 View
  101. Succi M, Rao A. Beyond the AJR: Towards Large Language Models for Radiology Decision-Making in the Emergency Department. American Journal of Roentgenology 2024 View
  102. Kunze K, Nwachukwu B, Cote M, Ramkumar P. Large Language Models Applied to Health Care Tasks May Improve Clinical Efficiency, Value of Care Rendered, Research, and Medical Education. Arthroscopy: The Journal of Arthroscopic & Related Surgery 2025;41(3):547 View
  103. Badia J, Casanova-Portoles D, Membrilla E, Rubiés C, Pujol M, Sancho J. Evaluation of ChatGPT-4 for the detection of surgical site infections from electronic health records after colorectal surgery: A pilot diagnostic accuracy study. Journal of Infection and Public Health 2025;18(2):102627 View
  104. Selim R, Basu A, Anto A, Foscht T, Eisingerich A. Effects of Large Language Model–Based Offerings on the Well-Being of Students: Qualitative Study. JMIR Formative Research 2024;8:e64081 View
  105. Chang Y, Yin J, Li J, Liu C, Cao L, Lin S. Applications and Future Prospects of Medical LLMs: A Survey Based on the M-KAT Conceptual Framework. Journal of Medical Systems 2024;48(1) View
  106. Van Meter A, Wheaton M, Cosgrove V, Andreadis K, Robertson R, Laroia G. The Goldilocks Zone: Finding the right balance of user and institutional risk for suicide-related generative AI queries. PLOS Digital Health 2025;4(1):e0000711 View
  107. Özkan T, Acar A, Özkan E, Düzyol M, Öztürk E. Are artificial intelligence based chatbots reliable sources for patients regarding orthodontics?. APOS Trends in Orthodontics 2025;15:141 View
  108. Sequí-Sabater J, Benavent D. Artificial intelligence in rheumatology research: what is it good for?. RMD Open 2025;11(1):e004309 View
  109. Rokhshad R, Khoury Z, Mohammad-Rahimi H, Motie P, Price J, Tavares T, Jessri M, Bavarian R, Sciubba J, Sultan A. Efficacy and empathy of AI chatbots in answering frequently asked questions on oral oncology. Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology 2025;139(6):719 View
  110. Wang S, Wang Y, Jiang L, Chang Y, zhang S, Zhao K, Chen L, Gao C. Assessing the clinical support capabilities of ChatGPT 4o and ChatGPT 4o mini in managing lumbar disc herniation. European Journal of Medical Research 2025;30(1) View
  111. Osborne M, Bailey E. Me vs. the machine? Subjective evaluations of human- and AI-generated advice. Scientific Reports 2025;15(1) View
  112. Knee C, Campbell R, Sivakumar B, Wines A, Symes M. Investigating the Accuracy and Consistency of ChatGPT in the Management of Achilles Tendon Ruptures. Cureus 2025 View
  113. Huo B, Boyle A, Marfo N, Tangamornsuksan W, Steen J, McKechnie T, Lee Y, Mayol J, Antoniou S, Thirunavukarasu A, Sanger S, Ramji K, Guyatt G. Large Language Models for Chatbot Health Advice Studies. JAMA Network Open 2025;8(2):e2457879 View
  114. Alessandro L, Crema S, Castiglione J, Dossi D, Eberbach F, Kohler A, Laffue A, Marone A, Nagel V, Pastor Rueda J, Varela F, Fernandez Slezak D, Rodríguez Murúa S, Debasa C, Claudio P, Farez M. Validation of an Artificial Intelligence-Powered Virtual Assistant for Emergency Triage in Neurology. The Neurologist 2025;30(3):155 View
  115. Wang X, Ye H, Zhang S, Yang M, Wang X. Evaluation of the Performance of Three Large Language Models in Clinical Decision Support: A Comparative Study Based on Actual Cases. Journal of Medical Systems 2025;49(1) View
  116. Aguirre J, Cha W. JAVIS Chat: A Seamless Open-Source Multi-LLM/VLM Deployment System to Be Utilized in Single Computers and Hospital-Wide Systems with Real-Time User Feedback. Applied Sciences 2025;15(4):1796 View
  117. Ayo-Ajibola O, Julien C, Lin M, Riddell J, Duan N, Kravitz R. Association of Primary Care Access with Health-Related ChatGPT Use: A National Cross-Sectional Survey. Journal of General Internal Medicine 2025 View
  118. Harkos C, Hadjigeorgiou A, Voutouri C, Kumar A, Stylianopoulos T, Jain R. Using mathematical modelling and AI to improve delivery and efficacy of therapies in cancer. Nature Reviews Cancer 2025;25(5):324 View
  119. Yu A, Li A, Ahmed W, Saturno M, Cho S. Evaluating Artificial Intelligence in Spinal Cord Injury Management: A Comparative Analysis of ChatGPT-4o and Google Gemini Against American College of Surgeons Best Practices Guidelines for Spine Injury. Global Spine Journal 2025 View
  120. Lin M, Lin L, Lin L, Lin Z, Yan X. A bibliometric analysis of the advance of artificial intelligence in medicine. Frontiers in Medicine 2025;12 View
  121. Rao A, Mu A, Enichen E, Gupta D, Hall N, Koranteng E, Marks W, Senter-Zapata M, Whitehead D, White B, Saini S, Landman A, Succi M. A Future of Self-Directed Patient Internet Research: Large Language Model-Based Tools Versus Standard Search Engines. Annals of Biomedical Engineering 2025;53(5):1199 View
  122. Winberg D, Xuan D, Tang T, Shi L. Assessing the suitability of generative AI in the execution of literature retrieval within literature reviews. Pharmacoeconomics and Policy 2025;1(1):21 View
  123. Zhu J, Jiang Y, Chen D, Lu Y, Huang Y, Lin Y, Fan P. High identification and positive‐negative discrimination but limited detailed grading accuracy of ChatGPT‐4o in knee osteoarthritis radiographs. Knee Surgery, Sports Traumatology, Arthroscopy 2025;33(5):1911 View
  124. Dobbins N. Generalizable and scalable multistage biomedical concept normalization leveraging large language models. Research Synthesis Methods 2025:1 View
  125. Batool H, Mukhtar A, Gul Khawaja S, Alghamdi N, Mansoor Khan A, Qayyum A, Adil R, Khan Z, Usman Akram M, Usman Akbar M, Eklund A. Knowledge Distillation and Transformer-Based Framework for Automatic Spine CT Report Generation. IEEE Access 2025;13:42949 View
  126. Pavlik E, Land Woodward J, Lawton F, Swiecki-Sikora A, Ramaiah D, Rives T. Artificial Intelligence in Relation to Accurate Information and Tasks in Gynecologic Oncology and Clinical Medicine—Dunning–Kruger Effects and Ultracrepidarianism. Diagnostics 2025;15(6):735 View
  127. Xue J, Wang Z, Chen N, Wu Y, Shen Z, Shao Y, Zhou H, Li Z. Evaluating multimodal ChatGPT for emergency decision-making of ocular trauma cases. Frontiers in Cell and Developmental Biology 2025;13 View
  128. Ozmen B, Mathur P. Evidence-based artificial intelligence: Implementing retrieval-augmented generation models to enhance clinical decision support in plastic surgery. Journal of Plastic, Reconstructive & Aesthetic Surgery 2025;104:414 View
  129. Succi M, Chang B, Rao A. Building the AI-Enabled Medical School of the Future. JAMA 2025;333(19):1665 View
  130. Chen X, Xiang J, Lu S, Liu Y, He M, Shi D. Evaluating large language models and agents in healthcare: key challenges in clinical applications. Intelligent Medicine 2025 View
  131. Deng M, He J, Miao J. Comparative analysis of AI models in disseminating genetic counseling knowledge for gynecologic cancers. International Journal of Gynecology & Obstetrics 2025 View
  132. Budler L, Chen H, Chen A, Topaz M, Tam W, Bian J, Stiglic G. A Brief Review on Benchmarking for Large Language Models Evaluation in Healthcare. WIREs Data Mining and Knowledge Discovery 2025;15(2) View
  133. Li S, Jiang J, Yang X. Preliminary assessment of large language models’ performance in answering questions on developmental dysplasia of the hip. Journal of Children's Orthopaedics 2025 View
  134. Hurt R, Stephenson C, Gilman E, Aakre C, Croghan I, Mundi M, Ghosh K, Edakkanambeth Varayil J. The Use of an Artificial Intelligence Platform OpenEvidence to Augment Clinical Decision-Making for Primary Care Physicians. Journal of Primary Care & Community Health 2025;16 View
  135. Yin Y, Zeng M, Wang H, Yang H, Zhou C, Jiang F, Wu S, Huang T, Yuan S, Lin J, Tang M, Chen J, Dong B, Yuan J, Xie D. A clinician-based comparative study of large language models in answering medical questions: the case of asthma. Frontiers in Pediatrics 2025;13 View
  136. Luo D, Liu M, Yu R, Liu Y, Jiang W, Fan Q, Kuang N, Gao Q, Yin T, Zheng Z. Evaluating the performance of GPT-3.5, GPT-4, and GPT-4o in the Chinese National Medical Licensing Examination. Scientific Reports 2025;15(1) View
  137. Mikhail D, Milad D, Antaki F, Milad J, Farah A, Khairy T, El-Khoury J, Bachour K, Szigiato A, Nayman T, Mullie G, Duval R. Multimodal Performance of GPT-4 in Complex Ophthalmology Cases. Journal of Personalized Medicine 2025;15(4):160 View
  138. Nguyen L, Connolly J, Nguyen H. A Systematic Review of Improving Knowledge Management with Generative AI and Large Language Models. Journal of Advances in Information Technology 2025;16(4):594 View
  139. Chokkakula S, Chong S, Yang B, Jiang H, Yu J, Han R, Attitalla I, Yin C, Zhang S. Quantum leap in medical mentorship: exploring ChatGPT’s transition from textbooks to terabytes. Frontiers in Medicine 2025;12 View
  140. Rao A, Kim J, Mu A, Young C, Kalmowitz E, Senter-Zapata M, Whitehead D, Garibyan L, Landman A, Succi M. Synthetic medical education in dermatology leveraging generative artificial intelligence. npj Digital Medicine 2025;8(1) View
  141. Kodweis K, Cory T, Hall E, George C, March K. Let's chat(GPT): Implementation of a ChatGPT-generated social determinants of health activity. Exploratory Research in Clinical and Social Pharmacy 2025;18:100553 View
  142. Shekar S, Pataranutaporn P, Sarabu C, Cecchi G, Maes P. People Overtrust AI-Generated Medical Advice despite Low Accuracy. NEJM AI 2025 View
  143. Weuthen F, Otte N, Krabbe H, Kraus T, Krabbe J. Comparison of ChatGPT and Internet Research for Clinical Research and Decision-Making in Occupational Medicine: Randomized Controlled Trial. JMIR Formative Research 2025;9:e63857 View

Books/Policy Documents

  1. Menad S, Abdeddaïm S, Soualmia L. Bioinformatics and Biomedical Engineering. View
  2. Menad S, Abdeddaïm S, Soualmia L. Knowledge Discovery, Knowledge Engineering and Knowledge Management. View

Conference Proceedings

  1. Fawzi S. 2023 5th Novel Intelligent and Leading Emerging Sciences Conference (NILES). A Review of the Role of ChatGPT for Clinical Decision Support Systems View
  2. Islam A, Biswas M, Zaghouani W, Belhaouari S, Shah Z. 2023 Tenth International Conference on Social Networks Analysis, Management and Security (SNAMS). Pushing Boundaries: Exploring Zero Shot Object Classification with Large Multimodal Models View
  3. Chaddad A, He C, Jiang Y. 2023 IEEE 23rd International Conference on Bioinformatics and Bioengineering (BIBE). ChatGPT: An Artificial Intelligence-Based Approach to Enhance Medical Applications View
  4. Chiang C, Lu Z, Li Z, Yin M. Proceedings of the 29th International Conference on Intelligent User Interfaces. Enhancing AI-Assisted Group Decision Making through LLM-Powered Devil's Advocate View
  5. Rajashekar N, Shin Y, Pu Y, Chung S, You K, Giuffre M, Chan C, Saarinen T, Hsiao A, Sekhon J, Wong A, Evans L, Kizilcec R, Laine L, Mccall T, Shung D. Proceedings of the CHI Conference on Human Factors in Computing Systems. Human-Algorithmic Interaction Using a Large Language Model-Augmented Artificial Intelligence Clinical Decision Support System View
  6. Taylor A, Magwira M, Chamangwana C, Chapuma E, Liwewe T, Kankhwali C. 2024 IEEE 12th International Conference on Healthcare Informatics (ICHI). Self-Directed Learning for Community Health Workers in Malawi Through Generative AI View
  7. Weerathunge T, Jayalal S, Wijayasiriwardhane K. 2025 5th International Conference on Advanced Research in Computing (ICARC). Optimizing Response Consistency of Large Language Models in Medical Education through Prompt Engineering View
  8. Sugan M, Nadkarni S, Sanaeipoor S, Patel S, Natarajamoorthy S, Rashidi E, Miller A. Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems. Exploring Caregivers' Acceptance of Conversational AI in Pediatric Cancer Caregiving: A Mixed-Methods Study View