This paper is in the following e-collection/theme issue:

Viewpoints and Perspectives (561) Artificial Intelligence (1674) Generative Language Models Including ChatGPT (467)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/52865, first published .
The Impact of Multimodal Large Language Models on Health Care’s Future

The Impact of Multimodal Large Language Models on Health Care’s Future

The Impact of Multimodal Large Language Models on Health Care’s Future

Authors of this article:

Bertalan Meskó1 Author Orcid Image
Article Authors Cited by (82) Tweetations (8) Metrics

Journals

  1. Larson H, Lin L. Generative artificial intelligence can have a role in combating vaccine hesitancy. BMJ 2024:q69 View
  2. Maki S, Furuya T, Inoue M, Shiga Y, Inage K, Eguchi Y, Orita S, Ohtori S. Machine Learning and Deep Learning in Spinal Injury: A Narrative Review of Algorithms in Diagnosis and Prognosis. Journal of Clinical Medicine 2024;13(3):705 View
  3. Denecke K, May R, Rivera-Romero O. Transformer Models in Healthcare: A Survey and Thematic Analysis of Potentials, Shortcomings and Risks. Journal of Medical Systems 2024;48(1) View
  4. Shaban-Nejad A, Michalowski M, Bianco S. Creative and generative artificial intelligence for personalized medicine and healthcare: Hype, reality, or hyperreality?. Experimental Biology and Medicine 2023;248(24):2497 View
  5. Pool J, Indulska M, Sadiq S. Large language models and generative AI in telehealth: a responsible use lens. Journal of the American Medical Informatics Association 2024;31(9):2125 View
  6. Mu Y, He D. The Potential Applications and Challenges of ChatGPT in the Medical Field. International Journal of General Medicine 2024;Volume 17:817 View
  7. Bitterman D, Downing A, Maués J, Lustberg M. Promise and Perils of Large Language Models for Cancer Survivorship and Supportive Care. Journal of Clinical Oncology 2024;42(14):1607 View
  8. Chow J, Wong V, Li K. Generative Pre-Trained Transformer-Empowered Healthcare Conversations: Current Trends, Challenges, and Future Directions in Large Language Model-Enabled Medical Chatbots. BioMedInformatics 2024;4(1):837 View
  9. Esmaeilzadeh P. Challenges and strategies for wide-scale artificial intelligence (AI) deployment in healthcare practices: A perspective for healthcare organizations. Artificial Intelligence in Medicine 2024;151:102861 View
  10. Araújo R, Ramalhete L, Viegas A, Von Rekowski C, Fonseca T, Calado C, Bento L. Simplifying Data Analysis in Biomedical Research: An Automated, User-Friendly Tool. Methods and Protocols 2024;7(3):36 View
  11. Ong J, Chang S, William W, Butte A, Shah N, Chew L, Liu N, Doshi-Velez F, Lu W, Savulescu J, Ting D. Ethical and regulatory challenges of large language models in medicine. The Lancet Digital Health 2024;6(6):e428 View
  12. Ostrowska M, Kacała P, Onolememen D, Vaughan-Lane K, Sisily Joseph A, Ostrowski A, Pietruszewska W, Banaszewski J, Wróbel M. To trust or not to trust: evaluating the reliability and safety of AI responses to laryngeal cancer queries. European Archives of Oto-Rhino-Laryngology 2024;281(11):6069 View
  13. Naqvi W, Shaikh S, Mishra G. Large language models in physical therapy: time to adapt and adept. Frontiers in Public Health 2024;12 View
  14. Leypold T, Lingens L, Beier J, Boos A. Integrating AI in Lipedema Management: Assessing the Efficacy of GPT-4 as a Consultation Assistant. Life 2024;14(5):646 View
  15. Sheikh M, Thongprayoon C, Suppadungsuk S, Miao J, Qureshi F, Kashani K, Cheungpasitporn W. Evaluating ChatGPT’s Accuracy in Responding to Patient Education Questions on Acute Kidney Injury and Continuous Renal Replacement Therapy. Blood Purification 2024;53(9):725 View
  16. Sridharan K, Sivaramakrishnan G. Enhancing readability of USFDA patient communications through large language models: a proof-of-concept study. Expert Review of Clinical Pharmacology 2024;17(8):731 View
  17. Tan S, Xin X, Wu D. ChatGPT in medicine: prospects and challenges: a review article. International Journal of Surgery 2024;110(6):3701 View
  18. Javaid M, Haleem A, Singh R. Health informatics to enhance the healthcare industry's culture: An extensive analysis of its features, contributions, applications and limitations. Informatics and Health 2024;1(2):123 View
  19. Haider S, Pressman S, Borna S, Gomez-Cabello C, Sehgal A, Leibovich B, Forte A. Evaluating Large Language Model (LLM) Performance on Established Breast Classification Systems. Diagnostics 2024;14(14):1491 View
  20. Wang Z, Yang W, Li Z, Rong Z, Wang X, Han J, Ma L. A 25-Year Retrospective of the Use of AI for Diagnosing Acute Stroke: Systematic Review. Journal of Medical Internet Research 2024;26:e59711 View
  21. Luo M, Pang J, Bi S, Lai Y, Zhao J, Shang Y, Cui T, Yang Y, Lin Z, Zhao L, Wu X, Lin D, Chen J, Lin H. Development and Evaluation of a Retrieval-Augmented Large Language Model Framework for Ophthalmology. JAMA Ophthalmology 2024;142(9):798 View
  22. Cheng J, Huang C, Zhang J, Wu B, Zhang W, Liu X, Zhang J, Tang Y, Zhou H, Zhang Q, Gu M, Dong J, Zhang X. Multimodal deep learning using on-chip diffractive optics with in situ training capability. Nature Communications 2024;15(1) View
  23. Isbary G, Zimmer E, Dettmar K, Zaiac M. KI zur Verbesserung des Informationsflusses zwischen verschiedenen Akteuren der Gesundheitsbranche und Pharmaindustrie. Forum 2024;39(4):309 View
  24. Leypold T, Schäfer B, Boos A, Beier J. Artificial Intelligence-Powered Hand Surgery Consultation: GPT-4 as an Assistant in a Hand Surgery Outpatient Clinic. The Journal of Hand Surgery 2024;49(11):1078 View
  25. Yang Z, Wang D, Zhou F, Song D, Zhang Y, Jiang J, Kong K, Liu X, Qiao Y, Chang R, Han Y, Li F, Tham C, Zhang X. Understanding natural language: Potential application of large language models to ophthalmology. Asia-Pacific Journal of Ophthalmology 2024;13(4):100085 View
  26. Sallam M, Al-Mahzoum K, Alshuaib O, Alhajri H, Alotaibi F, Alkhurainej D, Al-Balwah M, Barakat M, Egger J. Language discrepancies in the performance of generative artificial intelligence models: an examination of infectious disease queries in English and Arabic. BMC Infectious Diseases 2024;24(1) View
  27. PRATIK R CHABHADIYA , RIDHDHI HIRAPARA , ARUN KESHWALA . POTENTIAL OF LARGE LANGUAGE MODEL CHAT GENERATIVE PRE-TRAINED TRANSFORMER IN CONSTRUCTING MULTIPLE CHOICE QUESTIONS ON PHARMACOLOGY OF DIABETES. Asian Journal of Pharmaceutical and Clinical Research 2024:94 View
  28. MohanaSundaram A, Emran T. A commentary on ‘ChatGPT in medicine: prospects and challenges: a review article’ – correspondence. International Journal of Surgery 2024;110(8):5178 View
  29. Kikuchi T, Nakao T, Nakamura Y, Hanaoka S, Mori H, Yoshikawa T. Toward Improved Radiologic Diagnostics: Investigating the Utility and Limitations of GPT-3.5 Turbo and GPT-4 with Quiz Cases. American Journal of Neuroradiology 2024 View
  30. AlSaad R, Abd-alrazaq A, Boughorbel S, Ahmed A, Renault M, Damseh R, Sheikh J. Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook. Journal of Medical Internet Research 2024;26:e59505 View
  31. Chotcomwongse P, Ruamviboonsuk P, Grzybowski A. Utilizing Large Language Models in Ophthalmology: The Current Landscape and Challenges. Ophthalmology and Therapy 2024 View
  32. You J, Leung T, Pandita D, Sakumoto M. Primary Care Informatics: Vitalizing the Bedrock of Health Care. Journal of Medical Internet Research 2024;26:e60081 View
  33. Yu H, Fan L, Li L, Zhou J, Ma Z, Xian L, Hua W, He S, Jin M, Zhang Y, Gandhi A, Ma X. Large Language Models in Biomedical and Health Informatics: A Review with Bibliometric Analysis. Journal of Healthcare Informatics Research 2024;8(4):658 View
  34. Yanagita Y, Yokokawa D, Uchida S, Li Y, Uehara T, Ikusaka M. Can AI-Generated Clinical Vignettes in Japanese Be Used Medically and Linguistically?. Journal of General Internal Medicine 2024;39(16):3282 View
  35. Armbruster J, Bussmann F, Rothhaas C, Titze N, Grützner P, Freischmidt H. “Doctor ChatGPT, Can You Help Me?” The Patient’s Perspective: Cross-Sectional Study. Journal of Medical Internet Research 2024;26:e58831 View
  36. McCoy L, Ci Ng F, Sauer C, Yap Legaspi K, Jain B, Gallifant J, McClurkin M, Hammond A, Goode D, Gichoya J, Celi L. Understanding and training for the impact of large language models and artificial intelligence in healthcare practice: a narrative review. BMC Medical Education 2024;24(1) View
  37. Artsi Y, Sorin V, Glicksberg B, Nadkarni G, Klang E. Advancing Clinical Practice: The Potential of Multimodal Technology in Modern Medicine. Journal of Clinical Medicine 2024;13(20):6246 View
  38. Beard K, Pennington A, Gauff A, Mitchell K, Smith J, Marion D. Potential Applications and Ethical Considerations for Artificial Intelligence in Traumatic Brain Injury Management. Biomedicines 2024;12(11):2459 View
  39. Nzobonimpa S, Savard J, Caron I, Lawarée J. Automating public policy: a comparative study of conversational artificial intelligence models and human expertise in crafting briefing notes. AI & SOCIETY 2024 View
  40. Madanchian M. Generative AI for Consumer Behavior Prediction: Techniques and Applications. Sustainability 2024;16(22):9963 View
  41. Chen Y, Lehmann C, Malin B. Digital Information Ecosystems in Modern Care Coordination and Patient Care Pathways and the Challenges and Opportunities for AI Solutions. Journal of Medical Internet Research 2024;26:e60258 View
  42. Munro M, Gore R, Lynch C, Hastings Y, Reinhold A. Enhancing risk and crisis communication with computational methods: A systematic literature review. Risk Analysis 2024 View
  43. Ding Z, Wei R, Xia J, Mu Y, Wang J, Lin Y. Exploring the potential of large language model–based chatbots in challenges of ribosome profiling data analysis: a review. Briefings in Bioinformatics 2024;26(1) View
  44. Hasan S, Fury M, Woo J, Kunze K, Ramkumar P. Ethical Application of Generative Artificial Intelligence in Medicine. Arthroscopy: The Journal of Arthroscopic & Related Surgery 2025;41(4):874 View
  45. Agbareia R, Omar M, Soffer S, Glicksberg B, Nadkarni G, Klang E. Visual-textual integration in LLMs for medical diagnosis: A preliminary quantitative analysis. Computational and Structural Biotechnology Journal 2025;27:184 View
  46. Rashidian N, Abu Hilal M, Frigerio I, Guerra M, Sterckx S, Tozzi F, Capelli G, Verdi D, Spolverato G, Gulla A, Ratti F, Healey A, Esposito A, De Pastena M, Belli A, Bouwense S, Apostolos A, Lang S, López-López V, Stavrou G, Aldrighetti L, Strobel O, Croner R, Gumbs A. Ethics and trustworthiness of artificial intelligence in Hepato-Pancreato-Biliary surgery: a snapshot of insights from the European-African Hepato-Pancreato-Biliary Association (E-AHPBA) survey. HPB 2025;27(4):502 View
  47. Xu R, Hong Y, Zhang F, Xu H. Evaluation of the integration of retrieval-augmented generation in large language model for breast cancer nursing care responses. Scientific Reports 2024;14(1) View
  48. Biesheuvel L, Workum J, Reuland M, van Genderen M, Thoral P, Dongelmans D, Elbers P. Large language models in critical care. Journal of Intensive Medicine 2025;5(2):113 View
  49. Azimi I, Qi M, Wang L, Rahmani A, Li Y. Evaluation of LLMs accuracy and consistency in the registered dietitian exam through prompt engineering and knowledge retrieval. Scientific Reports 2025;15(1) View
  50. Malpani R, Moodley K. Large multimodal models: boon or burden for low- and middle-income countries. International Health 2025 View
  51. Liu Q, Yang R, Gao Q, Liang T, Wang X, Li S, Lei B, Gao K. A Review of Applying Large Language Models in Healthcare. IEEE Access 2025;13:6878 View
  52. Almubark I. Exploring the Impact of Large Language Models on Disease Diagnosis. IEEE Access 2025;13:8225 View
  53. Islam M, Spiro E, Yap P, Gorin M, Rowe S. The potential of generative AI with prostate-specific membrane antigen (PSMA) PET/CT: challenges and future directions. Medical Review 2025 View
  54. Wang Z, Yuan F, LeBaron V, Flickinger T, Barnes L. PALLM: Evaluating and Enhancing PALL iative Care Conversations with L arge L anguage M odels. ACM Transactions on Computing for Healthcare 2025 View
  55. Wu Y. Integrating AI·IoT-OAHPs with existing elderly care systems. DIGITAL HEALTH 2025;11 View
  56. de Ligt K, Hommes S, Vromans R, Boomstra E, van de Poll L, Krahmer E. Improving the Implementation of Patient-Reported Outcome Measure in Clinical Practice: Tackling Current Challenges With Innovative Digital Communication Technologies. Journal of Medical Internet Research 2025;27:e60777 View
  57. Ma W, Liu Y, Yi Q, Liu X, Xing W, Zhao R, Liu H, Li R, Federolf P. Table tennis coaching system based on a multimodal large language model with a table tennis knowledge base. PLOS ONE 2025;20(2):e0317839 View
  58. Liu Y, Cao X, Chen T, Jiang Y, You J, Wu M, Wang X, Feng M, Jin Y, Chen J. From screens to scenes: A survey of embodied AI in healthcare. Information Fusion 2025;119:103033 View
  59. Hou C, Gao Y, Lin X, Wu J, Li N, Lv H, Chu W. A review of recent artificial intelligence for traditional medicine. Journal of Traditional and Complementary Medicine 2025 View
  60. Yan B, Li K, Xu M, Dong Y, Zhang Y, Ren Z, Cheng X. On protecting the data privacy of Large Language Models (LLMs) and LLM agents: A literature review. High-Confidence Computing 2025:100300 View
  61. Levin C, Orkaby B, Kerner E, Saban M. Can large language models assist with pediatric dosing accuracy?. Pediatric Research 2025 View
  62. Samaranayake L, Tuygunov N, Schwendicke F, Osathanon T, Khurshid Z, Boymuradov S, Cahyanto A. The Transformative Role of Artificial Intelligence in Dentistry: A Comprehensive Overview. Part 1: Fundamentals of AI, and its Contemporary Applications in Dentistry. International Dental Journal 2025;75(2):383 View
  63. Hershenhouse J, Gill K, Nabhani J. The advance of artificial intelligence in outpatient urology: current applications and future directions. Current Opinion in Urology 2025;35(3):214 View
  64. McGrow K. Artificial intelligence in nursing. Nursing 2025;55(4):16 View
  65. Feng Y, Zhou Y, Xu J, Lu X, Gu R, Qiao Z. Integrating generative AI with neurophysiological methods in psychiatric practice. Asian Journal of Psychiatry 2025;108:104499 View
  66. Zheng D, Xiang S, Zhang Y, Guo X, Shi Y, Hao Y. Photonics Neural Networks for Multimodal Recognition Based on the Self-Activated MAC Function of DFB-SA. ACS Photonics 2025 View

Books/Policy Documents

  1. F. Heston T. A Comprehensive Overview of Telemedicine. View
  2. Kashefi A, Bosschaerts K, Murphy S, Van Hoecke S, Vanden Abeele M, De Marez L, Ongenae F, Conradie P. Human-Centered Design, Operation and Evaluation of Mobile Communications. View
  3. Henlein A, Bauer A, Bhattacharjee R, Ćwiek A, Gregori A, Kügler F, Lemanski J, Lücking A, Mehler A, Prieto P, Sánchez-Ramón P, Schepens J, Schulte-Rüther M, Schweinberger S, von Eiff C. Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. View
  4. Musunuri R, Bhatt A. Improving Healthcare Quality and Patient Engagement. View
  5. Rim D, Choi H. Proceedings of the Future Technologies Conference (FTC) 2024, Volume 1. View
  6. Di Ieva A, Stewart C, Suero Molina E. Computational Neurosurgery. View
  7. Nobel J. AI Implementation in Radiology. View
  8. Hernández-Gómez K, Gil-Gonzalez J, Cárdenas-Peña D, Orozco-Gutiérrez Á. Advances in Computing. View
  9. Lavan J, Sangeetha L. Explainable Artificial Intelligence in the Healthcare Industry. View

Conference Proceedings

  1. Wu M, Lin H, Lyu X, Zhang C, Yu S. 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). Enabling Large Language Models to Think Twice When Its Answer Is Unreliable: A Case Study In Cancer Screening View
  2. Khan S, Biswas M, Murad A, Ali H, Shah Z. 2024 IEEE International Conference on Information Reuse and Integration for Data Science (IRI). An Early Investigation into the Utility of Multimodal Large Language Models in Medical Imaging View
  3. Mir A, Thadei Luoga L, Chen B, Hanif M, Shafique M. 2024 IEEE International Conference on Image Processing Challenges and Workshops (ICIPCW). Democratizing MLLMs in Healthcare: TinyLLaVA-Med for Efficient Healthcare Diagnostics in Resource-Constrained Settings View
  4. Ma M, Yang Y, Han Y, Deng X, Fan Q, Feng Y. 2024 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). Integrating Advanced Language Models and Economic Incentives for Domain Adaptive Medical Data Stewardship View
  5. Trad F, Chehab A. 2024 2nd International Conference on Foundation and Large Language Models (FLLM). Large Multimodal Agents for Accurate Phishing Detection with Enhanced Token Optimization and Cost Reduction View
  6. Rasheed A, Chasib S, Alabbas H, Zarkoosh M, Abbas S. 2024 IEEE International Conference on Machine Learning and Applied Network Technologies (ICMLANT). IELTS Writing Tasks Evaluation Using LLMs: A Comparative Study of ChatGPT, Claude, Copilot, and Google Gemini View
  7. Inoshita K, Zhou X. 2024 IEEE International Conference on Big Data and Cloud Computing (BDCloud). Sentiment Bias and Security Analysis in Training Datasets of Large Language Models View