This paper is in the following e-collection/theme issue:

Viewpoints and Perspectives (566) Generative Language Models Including ChatGPT (481) AI Language Models in Health Care (99) Artificial Intelligence (1708) Data Science (305) New Methods (1029) Clinical Informatics (1155) Big Data (278) Electronic Health Records (1176)

Published on in Vol 26 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/59505, first published .
Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook

Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook

Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook

Authors of this article:

Rawan AlSaad1 Author Orcid Image ;   Alaa Abd-alrazaq1 Author Orcid Image ;   Sabri Boughorbel2 Author Orcid Image ;   Arfan Ahmed1 Author Orcid Image ;   Max-Antoine Renault1 Author Orcid Image ;   Rafat Damseh3 Author Orcid Image ;   Javaid Sheikh1 Author Orcid Image
Article Authors Cited by (25) Tweetations (8) Metrics

Journals

  1. Swinckels L, de Keijzer A, Loos B, Applegate R, Kookal K, Kalenderian E, Bijwaard H, Bruers J. A personalized periodontitis risk based on nonimage electronic dental records by machine learning. Journal of Dentistry 2025;153:105469 View
  2. Lin Y, Cheng M, Wu C, Huang Y, Zhu T, Li J, Gao H, Wang K. MRI-based artificial intelligence models for post-neoadjuvant surgery personalization in breast cancer: a narrative review of evidence from Western Pacific. The Lancet Regional Health - Western Pacific 2025;57:101254 View
  3. Chaabene S, Boudaya A, Bouaziz B, Chaari L. An overview of methods and techniques in multimodal data fusion with application to healthcare. International Journal of Data Science and Analytics 2025 View
  4. Saraiva M, Ribeiro T, Agudo B, Afonso J, Mendes F, Martins M, Cardoso P, Mota J, Almeida M, Costa A, Gonzalez Haba Ruiz M, Widmer J, Moura E, Javed A, Manzione T, Nadal S, Barroso L, de Parades V, Ferreira J, Macedo G. Evaluating ChatGPT-4 for the Interpretation of Images from Several Diagnostic Techniques in Gastroenterology. Journal of Clinical Medicine 2025;14(2):572 View
  5. Nazar W, Nazar G, Kamińska A, Danilowicz-Szymanowicz L. How to Design, Create, and Evaluate an Instruction-Tuning Dataset for Large Language Model Training in Health Care: Tutorial From a Clinical Perspective. Journal of Medical Internet Research 2025;27:e70481 View
  6. Liu Y, Cao X, Chen T, Jiang Y, You J, Wu M, Wang X, Feng M, Jin Y, Chen J. From screens to scenes: A survey of embodied AI in healthcare. Information Fusion 2025;119:103033 View
  7. Chen Y, Zhang C, Bai R, Sun T, Ding W, Wang R. A review of medical text analysis: Theory and practice. Information Fusion 2025;119:103024 View
  8. Chen Y, Shao X, Shi K, Rominger A, Caobelli F. AI in Breast Cancer Imaging: An Update and Future Trends. Seminars in Nuclear Medicine 2025;55(3):358 View
  9. Davalan W, Khalaf R, Diaz R. Reproduction of Original Glioblastoma and Brain Metastasis Research Findings Using Synthetic Data. World Neurosurgery 2025;196:123808 View
  10. Zhou M, Pan Y, Zhang Y, Song X, Zhou Y. Evaluating AI-generated patient education materials for spinal surgeries: Comparative analysis of readability and DISCERN quality across ChatGPT and deepseek models. International Journal of Medical Informatics 2025;198:105871 View
  11. Alsaedi S, Gao X, Gojobori T. Beyond digital twins: the role of foundation models in enhancing the interpretability of multiomics modalities in precision medicine. FEBS Open Bio 2025 View
  12. Saadh M, Ahmed H, Kareem R, Yadav A, Ganesan S, Shankhyan A, Sharma G, Naidu K, Rakhmatullaev A, Sameer H, Yaseen A, Athab Z, Adil M, Farhood B. Advanced machine learning framework for enhancing breast cancer diagnostics through transcriptomic profiling. Discover Oncology 2025;16(1) View
  13. Navarro-Garcia D, Marcos A, Beets-Tan R, Blomqvist L, Bodalal Z, Deandreis D, Crispin-Ortuzar M, Gallagher F, Giandini T, Graves M, Lassau N, Maier-Hein K, Prelaj A, Schader P, Schlemmer H, Sedlaczek O, Vaiani M, Perez-Lopez R. Real-world radiology data for artificial intelligence-driven cancer support systems and biomarker development. ESMO Real World Data and Digital Oncology 2025;8:100120 View
  14. Michalowski M, Topaz M, Peltonen L. An AI‐Enabled Nursing Future With no Documentation Burden: A Vision for a New Reality. Journal of Advanced Nursing 2025 View
  15. Wang H, Binti Md Yassin A, Shen S. Research on Medical Intelligent Decision Support System Integrating Multimodal AI Big Data. SHS Web of Conferences 2025;213:02033 View
  16. Kwan H, Shell J, Fahy C, Yang S, Xing Y. Integrating Large Language Models into Medication Management in Remote Healthcare: Current Applications, Challenges, and Future Prospects. Systems 2025;13(4):281 View
  17. Muasher-Kerwin C, Hughes M, Foster M, Al Azher I, Alhoori H. Exploring large language models for summarizing and interpreting an online brain tumor support forum. DIGITAL HEALTH 2025;11 View
  18. Li J, Li Z, Jian F. Letter to the Editor of the Journal of Medical Systems: Regarding “Evaluation of the Performance of Three Large Language Models in Clinical Decision Support: A Comparative Study Based on Actual Cases”. Journal of Medical Systems 2025;49(1) View
  19. Rouzrokh P, Khosravi B, Faghani S, Moassefi M, Shariatnia M, Rouzrokh P, Erickson B. A Current Review of Generative AI in Medicine: Core Concepts, Applications, and Current Limitations. Current Reviews in Musculoskeletal Medicine 2025 View
  20. Gelen M, Barua P, Tasci I, Tasci G, Aydemir E, Dogan S, Tuncer T, Acharya U. Novel accurate classification system developed using order transition pattern feature engineering technique with physiological signals. Scientific Reports 2025;15(1) View

Conference Proceedings

  1. Li J, Yuan R, Tian Y, Li J. 2024 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). Towards Instruction-Tuned Verification for Improving Biomedical Information Extraction with Large Language Models View
  2. Mohan D, Prabha M, Nair A. 2024 4th International Conference on Ubiquitous Computing and Intelligent Information Systems (ICUIS). Hybrid Deep Learning for RNA-Protein Binding Prediction with Hierarchical Features and Debiasing View
  3. Vengatachalam S, Rakkiannan T. 2025 10th International Conference on Signal Processing and Communication (ICSC). Transforming Healthcare with AI: Multimodal VQA Systems and LLMs View
  4. Vasir G, Huh-Yoo J. Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems. Characterizing the Flaws of Image-Based AI-Generated Content View
  5. Lin R. 2024 IEEE/WIC International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT). AI-Driven Personalized Healthcare: Leveraging Multimodal Data for Precision Medicine View