Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/47551, first published .
Security Implications of AI Chatbots in Health Care

Security Implications of AI Chatbots in Health Care

Security Implications of AI Chatbots in Health Care

Authors of this article:

Jingquan Li1 Author Orcid Image

Journals

  1. Chow J, Wong V, Li K. Generative Pre-Trained Transformer-Empowered Healthcare Conversations: Current Trends, Challenges, and Future Directions in Large Language Model-Enabled Medical Chatbots. BioMedInformatics 2024;4(1):837 View
  2. Meyer A, Ruthard J, Streichert T. Dear ChatGPT – can you teach me how to program an app for laboratory medicine?. Journal of Laboratory Medicine 2024;48(5):197 View
  3. Schillings C, Meißner E, Erb B, Bendig E, Schultchen D, Pollatos O. Effects of a Chatbot-Based Intervention on Stress and Health-Related Parameters in a Stressed Sample: Randomized Controlled Trial. JMIR Mental Health 2024;11:e50454 View
  4. Giuffrè M, Kresevic S, You K, Dupont J, Huebner J, Grimshaw A, Shung D. Systematic review: The use of large language models as medical chatbots in digestive diseases. Alimentary Pharmacology & Therapeutics 2024;60(2):144 View
  5. Giuffrè M, Kresevic S, Pugliese N, You K, Shung D. Optimizing large language models in digestive disease: strategies and challenges to improve clinical outcomes. Liver International 2024;44(9):2114 View
  6. Zhui L, Fenghe L, Xuehu W, Qining F, Wei R. Ethical Considerations and Fundamental Principles of Large Language Models in Medical Education: Viewpoint. Journal of Medical Internet Research 2024;26:e60083 View
  7. Huo W, He M, Zeng Z, Bao X, Lu Y, Tian W, Feng J, Feng R. Impact Analysis of COVID-19 Pandemic on Hospital Reviews on Dianping Website in Shanghai, China: Empirical Study. Journal of Medical Internet Research 2024;26:e52992 View
  8. Mestrovic A, Perkovic N, Bozic D, Kumric M, Vilovic M, Bozic J. Precision Medicine in Inflammatory Bowel Disease: A Spotlight on Emerging Molecular Biomarkers. Biomedicines 2024;12(7):1520 View
  9. Lavigne S, Rios A, Davis J. Does generative artificial intelligence pose a risk to performance validity test security?. The Clinical Neuropsychologist 2024:1 View
  10. Reis M, Reis F, Kunde W. Influence of believed AI involvement on the perception of digital medical advice. Nature Medicine 2024;30(11):3098 View
  11. Zhui L, Yhap N, Liping L, Zhengjie W, Zhonghao X, Xiaoshu Y, Hong C, Xuexiu L, Wei R. Impact of Large Language Models on Medical Education and Teaching Adaptations. JMIR Medical Informatics 2024;12:e55933 View
  12. Jahangir Z, Muddassir Qureshi S, Abdul Rehman Y, Ur Rehman Shah S, Ahmed Qureshi H, Ahmad A. Revolutionizing AI-driven Hypertension Care: A Review of Current Trends and Future Directions. Journal of Science & Technology 2024;5(4):99 View
  13. Xu T, Weng H, Liu F, Yang L, Luo Y, Ding Z, Wang Q. Current Status of ChatGPT Use in Medical Education: Potentials, Challenges, and Strategies. Journal of Medical Internet Research 2024;26:e57896 View
  14. Chow J, Li K. Ethical Considerations in Human-Centered AI: Advancing Oncology Chatbots Through Large Language Models. JMIR Bioinformatics and Biotechnology 2024;5:e64406 View
  15. Armbruster J, Bussmann F, Rothhaas C, Titze N, Grützner P, Freischmidt H. “Doctor ChatGPT, Can You Help Me?” The Patient’s Perspective: Cross-Sectional Study. Journal of Medical Internet Research 2024;26:e58831 View
  16. Mese I, Kocak B. ChatGPT as an effective tool for quality evaluation of radiomics research. European Radiology 2024;35(4):2030 View
  17. Gorelik Y. Response. Gastrointestinal Endoscopy 2024;100(4):782 View
  18. Ezanno A, Fougerousse A, Pruvost-Balland C, Maccari F, Fite C. AI in Hidradenitis Suppurativa: Expert Evaluation of Patient-Facing Information. Clinical, Cosmetic and Investigational Dermatology 2024;Volume 17:2459 View
  19. Hasanov I, Virtanen S, Hakkala A, Isoaho J. Application of Large Language Models in Cybersecurity: A Systematic Literature Review. IEEE Access 2024;12:176751 View
  20. Ali S, Rahman F, Kuwar A, Khanna T, Nayak A, Sharma P, Dasraj S, Auer S, Rouf R, Patel T, Dhar B. Rapid, Tailored Dietary and Health Education Through A Social Media Chatbot Microintervention: Development and Usability Study With Practical Recommendations. JMIR Formative Research 2024;8:e52032 View
  21. Teoman A, Serefoglu E. Artificial Intelligence-Based Clinical Decision-Making in Erectile Dysfunction: a Narrative Review. Current Urology Reports 2025;26(1) View
  22. Sabaner M, Anguita R, Antaki F, Balas M, Boberg-Ans L, Ferro Desideri L, Grauslund J, Hansen M, Klefter O, Potapenko I, Rasmussen M, Subhi Y. Opportunities and Challenges of Chatbots in Ophthalmology: A Narrative Review. Journal of Personalized Medicine 2024;14(12):1165 View
  23. Glover W, Renton M, Minaye H, Dabiri O. Assessing Equitable Development and Implementation of Artificial Intelligence-Enabled Patient Engagement Technologies: A Sociotechnical Systems Approach. Mayo Clinic Proceedings: Digital Health 2025;3(1):100192 View
  24. Saha K, Jain Y, Liu C, Kaliappan S, Karkar R. AI vs. Humans for Online Support: Comparing the Language of Responses from LLMs and Online Communities of Alzheimer’s Disease. ACM Transactions on Computing for Healthcare 2025 View
  25. Lawson McLean A, Hristidis V. Evidence-Based Analysis of AI Chatbots in Oncology Patient Education: Implications for Trust, Perceived Realness, and Misinformation Management. Journal of Cancer Education 2025;40(4):482 View
  26. Chow J, Li K. Developing Effective Frameworks for Large Language Model–Based Medical Chatbots: Insights From Radiotherapy Education With ChatGPT. JMIR Cancer 2025;11:e66633 View
  27. Jumreornvong O, Perez A, Malave B, Mozawalla F, Kia A, Nwaneshiudu C. Biases in Artificial Intelligence Application in Pain Medicine. Journal of Pain Research 2025;Volume 18:1021 View
  28. Rajakumar H. Global Artificial Intelligence Arms Race: The Future of Artificial Intelligence in Medicine. Mayo Clinic Proceedings: Digital Health 2025;3(2):100207 View
  29. Salyers A, Bull S, Silvasstar J, Howell K, Wright T, Banaei-Kashani F. Building and Beta-Testing Be Well Buddy Chatbot, a Secure, Credible and Trustworthy AI Chatbot That Will Not Misinform, Hallucinate or Stigmatize Substance Use Disorder: Development and Usability Study. JMIR Human Factors 2025;12:e69144 View
  30. Mondal H, Mondal S. The Role of Large Language Model Chatbots in Sexual Education: An Unmet Need of Research. Journal of Psychosexual Health 2025;7(2):120 View
  31. Branda F, Stella M, Ceccarelli C, Cabitza F, Ceccarelli G, Maruotti A, Ciccozzi M, Scarpa F. The Role of AI-Based Chatbots in Public Health Emergencies: A Narrative Review. Future Internet 2025;17(4):145 View
  32. Maheshwari A, Motta M, Lui K. Editorial. Newborn 2025;4(1):iv View
  33. Ostrovsky A. Evaluating a large language model's accuracy in chest X-ray interpretation for acute thoracic conditions. The American Journal of Emergency Medicine 2025;93:99 View
  34. Triola M, Rodman A. Integrating Generative Artificial Intelligence Into Medical Education: Curriculum, Policy, and Governance Strategies. Academic Medicine 2025;100(4):413 View
  35. Hung J, Hartanto A, Goh A, Eun Z, Kasturiratna K, Lee Z, Majeed N. The efficacy of incorporating Artificial Intelligence (AI) chatbots in brief gratitude and self-affirmation interventions: Evidence from two exploratory experiments. Computers in Human Behavior: Artificial Humans 2025;4:100151 View
  36. Mushtaq S, Hameeda Q. Empowering Public Health: AI‐Powered Security Solutions for AI‐Driven Challenges. Applied AI Letters 2025;6(2) View
  37. Reyes C, Nguyen E, Alexander L, Bhayana R, Deahl Z, Khandelwal A, Mayes C, Zulfiqar M, Tan N. Beyond Human Limits: The Promise and Pitfalls of Large Language Models in Radiology Research. Journal of Computer Assisted Tomography 2025;49(4):545 View
  38. Makaya C, Kassar G. Santé mentale au travail et intelligence artificielle : entre soutien psychologique et risque de dépendance. Annales des Mines - Enjeux numériques 2025;n° 29(1):85 View
  39. Liu H, Peng J, Li L, Deng A, Huang X, Yin G, Luo H. Large Language Models as a Consulting Hotline for Patients With Breast Cancer and Specialists in China: Cross-Sectional Questionnaire Study. JMIR Medical Informatics 2025;13:e66429 View
  40. Wang C, Zhu Y, Zhang X, Chen X, Li Y, Tan Y, Qi H. Areas of research focus and trends in the research on the application of AIGC in healthcare. Journal of Health, Population and Nutrition 2025;44(1) View
  41. Chow J, Li K. Large Language Models in Medical Chatbots: Opportunities, Challenges, and the Need to Address AI Risks. Information 2025;16(7):549 View
  42. İnan M, Suvak Ö, Aypak C. AI in primary care: Comparing ChatGPT and family physicians on patient queries. International Journal of Medical Informatics 2025;203:106047 View
  43. Chen Y, Xiong Y, Ding X, Yang F, Deng Y, Ma N, Li Y. CloudEcho: Exploring the Role of Large Conversational Language Models in Enhancing Home Care Models and Communication Quality. International Journal of Human–Computer Interaction 2025:1 View
  44. Li K, Wu S, Zhang Y, Zhu B, Qi Z, Hou S, Wang W. The Usability and Experience of Artificial Intelligence‐Based Conversational Agents in Health Education for Cancer Patients: A Scoping Review. Journal of Clinical Nursing 2025 View
  45. Li Z, Fu Q, Zhao Y, Ren W. Empowering standardized residency training in China through large language models: problem analysis and solutions. Annals of Medicine 2025;57(1) View
  46. Bheemireddy S, Leslie S, Durden J, Burnet G, Aryanpour Z, Fong A, Higgins M, Greenseid S, McLemore L, Li G, Miles R, Taft N, Tevis S. The Use of ChatGPT-4.0 to Simplify Breast Pathology Reports: A Study on Readability and Accuracy. Annals of Surgical Oncology 2025;32(11):8400 View
  47. Simon B, Ozyoruk K, Gelikman D, Harmon S, Türkbey B. The future of multimodal artificial intelligence models for integrating imaging and clinical metadata: a narrative review. Diagnostic and Interventional Radiology 2024 View
  48. Woite N, Gameiro R, Leite M, Hammond A, Cobanaj M, Celi L. Understanding artificial intelligence in critical care: opportunities, risks, and practical applications. Critical Care Science 2025;37 View
  49. Ibas M, Dursun S, Paksoy M, Ocal R, Karatas E. Accuracy and safety of ChatGPT-4o responses in rhinoplasty postoperative counseling: a panel-based study. Acta Oto-Laryngologica 2025;145(9):851 View
  50. Ziab H, Mazbouh R, Siblini F, Nashwan A. Transforming Pediatric Physiotherapy: The Role of ChatGPT in Therapy, Limitations, and Ethical Considerations. Cureus 2025 View
  51. Brennan K. Chatbots in sexual and reproductive health: bridging the divide in accessibility and equity. Contraception 2025:111199 View
  52. Ghasemi S, Amiri P, Galavi Z. Advantages and Limitations of ChatGPT in Healthcare: A Scoping Review. Health Science Reports 2025;8(9) View
  53. Yi Y, Kaiser-Jackson L, Bather J, Goodman M, Chavez-Yenter D, Bradshaw R, Chambers R, Espinel W, Hess R, Mann D, Monahan R, Wetter D, Ginsburg O, Sigireddi M, Kawamoto K, Del Fiol G, Buys S, Kaphingst K. Bridging Technology and Pretest Genetic Services: Quantitative Study of Chatbot Interaction Patterns, User Characteristics, and Genetic Testing Decisions. Journal of Medical Internet Research 2025;27:e73391 View
  54. Yi P, Haver H, Jeudy J, Kim W, Kitamura F, Oluyemi E, Smith A, Moy L, Parekh V. Best Practices for the Safe Use of Large Language Models and Other Generative AI in Radiology. Radiology 2025;316(3) View
  55. Boit S, Patil R. A Prompt Engineering Framework for Large Language Model–Based Mental Health Chatbots: Conceptual Framework. JMIR Mental Health 2025;12:e75078 View
  56. Giri R, Firdhos S, Vida T. Artificial Intelligence in Anesthesia: Enhancing Precision, Safety, and Global Access Through Data-Driven Systems. Journal of Clinical Medicine 2025;14(19):6900 View
  57. Papneja H, Devaraj S. Unlocking Privacy in Healthcare: The Impact of Explanations on Privacy Concerns and Self‐Disclosure to Conversational Technologies. Journal of Operations Management 2025 View
  58. Monteith S, Glenn T, Geddes J, Whybrow P, Achtyes E, Bauer M. Anthropomorphic technology in everyday life: focus on chatbots and impacts on mental health. European Archives of Psychiatry and Clinical Neuroscience 2025 View
  59. Bigolin A, Nunes Chibiaque de Lima J, Machado Grossi J, Hartmann Rost I, Machado da Rosa M, Piccolotto Concolatto F. Could ChatGPT Be a Tool Capable of Providing Qualified, Empathetic, and Assertive Answers to Patients After Bariatric Surgery? A Comparative Analysis of Its Versions. Obesity Surgery 2025;35(11):4605 View
  60. Wu Q, Liu X, Zhong R. Study of adoption of AI-generated health information in video platforms using SEM and fsQCA. Aslib Journal of Information Management 2025:1 View
  61. Mohammad talebi H, Safarabadi M, Mousivand M, Zarei A, Fakhari M. Role of artificial intelligence powered chatbots in diabetes self-management: A narrative review. Proceedings of Singapore Healthcare 2025;34 View
  62. Christina J, Ford K, Menz B, Sorich M, Hopkins A, Ramsey I, Duddle M, Kitson A, Paterson C. Integrating the Caring Life Course Theory and Artificial Intelligence Applications to Enhance Cancer Care Across the Continuum. Seminars in Oncology Nursing 2025;41(6):152040 View
  63. Yener R, Chen G, Gumusel E, Bashir M. Can I Trust This Chatbot? Assessing User Privacy in AI‐Healthcare Chatbot Applications. Proceedings of the Association for Information Science and Technology 2025;62(1):809 View
  64. Fußhöller A, Lechner F, Schlicker N, Muehlensiepen F, Mayr A, Kuhn S, Hirsch M, Knitza J. Perceptions, Usage, and Educational Impact of ChatGPT Among Medical Students in Germany: Cross-Sectional Mixed Methods Survey. JMIR Formative Research 2025;9:e81484 View
  65. Ng J. Adapt or Lag Behind: Why Researchers in Traditional, Complementary, and Integrative Medicine Must Master Prompt Engineering in the Era of Artificial Intelligence. Perspectives on Integrative Medicine 2025;4(3):127 View
  66. Schnegg-Kaufmann A, Bacher U, Rovó A, Andres M, Wiedemann G, Porret N, Moshaver B, Kaufmann N, Tchinda J, Meyer S, Angelillo-Scherrer A. Artificial Intelligence in Haematologic Diagnostics: Current Applications and Future Perspectives. Acta Haematologica 2025:1 View
  67. de Morais E, de Souto Medeiros M, Moreira D, de Oliveira L, de Almeida Freitas R. Artificial Intelligence chatbots in oral pathology: a scoping review of applications, accuracy, and limitations. European Archives of Oto-Rhino-Laryngology 2025 View
  68. Liebovitz D, Wu A, Reamer C, Vadasz B. Artificial Intelligence and Machine Learning in Health Care. Medical Clinics of North America 2025 View
  69. Tang W, Hang Y, Zhang J, Dang Y. Recent Advances and Future Directions of Artificial Intelligence in Glaucoma Management. The Open Ophthalmology Journal 2025;19(1) View

Books/Policy Documents

  1. Bangash S, Shah S, Adam M, Khan M, Ahmad M. Multifaceted Uses of Cutting-Edge Technologies and Social Concerns. View
  2. Zobel T, Meinel C. Advances in Information and Communication. View
  3. Wu L. Chatbots and Mental Healthcare in Psychology and Psychiatry. View
  4. Ayalon A, Wasser L, Williams A, Sahel J. Artificial Intelligence in Ophthalmology. View
  5. Chatterjee S, Dindarian A, Rengaraju U. Revolutionizing Youth Mental Health with Ethical AI. View

Conference Proceedings

  1. Reddy P, Reddy K, Jayanth P, Kavitha C. 2024 8th International Conference on Electronics, Communication and Aerospace Technology (ICECA). End-To-End Encrypted Agriculture Chatbot View
  2. Rashik M, Sweth S, Agrawal N, Kochar S, Smith K, Rajabiyazdi F, Setlur V, Mahyar N, Sarvghad A. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. AI-Enabled Conversational Journaling for Advancing Parkinson's Disease Symptom Tracking View
  3. Deva R, Ramani D, Divate T, Jalota S, Ismail A. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. "Kya family planning after marriage hoti hai?": Integrating Cultural Sensitivity in an LLM Chatbot for Reproductive Health View
  4. M B, A A, R A, S M, S S, K S. 2025 3rd International Conference on Self Sustainable Artificial Intelligence Systems (ICSSAS). AI & ML Driven Health Assistant for Disease Prediction and Management View
  5. di Bona K, Ijaz K, Ahmadpour N. Proceedings of the 37th Australian Conference on Human-Computer Interaction. "AI that’s so good it almost seems human:" Risk and Hype Cycles of AI and Chatbots in Mobile Mental Health Apps View