This paper is in the following e-collection/theme issue:

Tutorial (64) Chatbots and Conversational Agents (514) Artificial Intelligence (1323) e-Learning and Medical Education (683) Consumer & Patient Education and Shared-Decision Making (667) Learning and Education (73) Tutorials in Medical Education (5)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/50638, first published .
Prompt Engineering as an Important Emerging Skill for Medical Professionals: Tutorial

Prompt Engineering as an Important Emerging Skill for Medical Professionals: Tutorial

Prompt Engineering as an Important Emerging Skill for Medical Professionals: Tutorial

Authors of this article:

Bertalan Meskó1 Author Orcid Image
Article Authors Cited by (118) Tweetations (32) Metrics

Journals

  1. Meskó B. The Impact of Multimodal Large Language Models on Health Care’s Future. Journal of Medical Internet Research 2023;25:e52865 View
  2. Lund B. The prompt engineering librarian. Library Hi Tech News 2023;40(8):6 View
  3. Sallam M, Barakat M, Sallam M. Pilot Testing of a Tool to Standardize the Assessment of the Quality of Health Information Generated by Artificial Intelligence-Based Models. Cureus 2023 View
  4. Shu L, He Q, Yan B, Wu D, Wang M, Wang C, Zhang L. Human‐in‐the‐loop: Human involvement in enhancing medical inquiry performance in large language models. Allergy 2024;79(5):1348 View
  5. Sallam M, Al-Salahat K. Below average ChatGPT performance in medical microbiology exam compared to university students. Frontiers in Education 2023;8 View
  6. Sallam M, Al-Salahat K, Al-Ajlouni E. ChatGPT Performance in Diagnostic Clinical Microbiology Laboratory-Oriented Case Scenarios. Cureus 2023 View
  7. Non L. All aboard the ChatGPT steamroller: Top 10 ways to make artificial intelligence work for healthcare professionals. Antimicrobial Stewardship & Healthcare Epidemiology 2023;3(1) View
  8. Patil N, Huang R, Caterine S, Yao J, Larocque N, van der Pol C, Stubbs E. Artificial Intelligence Chatbots’ Understanding of the Risks and Benefits of Computed Tomography and Magnetic Resonance Imaging Scenarios. Canadian Association of Radiologists Journal 2024;75(3):518 View
  9. NYAABA M, ZHAI X. Generative AI Professional Development Needs for Teacher Educators. Journal of AI 2024;8(1):1 View
  10. Sallam M, Barakat M, Sallam M. A Preliminary Checklist (METRICS) to Standardize the Design and Reporting of Studies on Generative Artificial Intelligence–Based Models in Health Care Education and Practice: Development Study Involving a Literature Review. Interactive Journal of Medical Research 2024;13:e54704 View
  11. Mishra V, Sarraju A, Kalwani N, Dexter J. Evaluation of Prompts to Simplify Cardiovascular Disease Information Generated Using a Large Language Model: Cross-Sectional Study. Journal of Medical Internet Research 2024;26:e55388 View
  12. Durieux B, Davis J, Moons P, Van Bulck L. How to get the most out of ChatGPT? Tips and tricks on prompting. European Journal of Cardiovascular Nursing 2024 View
  13. Wang L, Chen X, Deng X, Wen H, You M, Liu W, Li Q, Li J. Prompt engineering in consistency and reliability with the evidence-based guideline for LLMs. npj Digital Medicine 2024;7(1) View
  14. Huber S, Kiili K, Nebel S, Ryan R, Sailer M, Ninaus M. Leveraging the Potential of Large Language Models in Education Through Playful and Game-Based Learning. Educational Psychology Review 2024;36(1) View
  15. Liu S, McCoy A, Wright A, Nelson S, Huang S, Ahmad H, Carro S, Franklin J, Brogan J, Wright A. Why do users override alerts? Utilizing large language model to summarize comments and optimize clinical decision support. Journal of the American Medical Informatics Association 2024;31(6):1388 View
  16. Ghanem Y, Rouhi A, Al-Houssan A, Saleh Z, Moccia M, Joshi H, Dumon K, Hong Y, Spitz F, Joshi A, Kwiatt M. Dr. Google to Dr. ChatGPT: assessing the content and quality of artificial intelligence-generated medical information on appendicitis. Surgical Endoscopy 2024;38(5):2887 View
  17. Chiu T, Ahmad Z, Ismailov M, Sanusi I. What are artificial intelligence literacy and competency? A comprehensive framework to support them. Computers and Education Open 2024;6:100171 View
  18. Kaba E, Solak M, Çeliker F. The Role of Prompt Engineering in Radiology Applications of Generative AI. Academic Radiology 2024;31(6):2641 View
  19. Sarangi P, Mondal H. Response Generated by Large Language Models Depends on the Structure of the Prompt. Indian Journal of Radiology and Imaging 2024;34(03):574 View
  20. Chen J, Granet D. Prompt Engineering: Helping ChatGPT Respond Better to Patients and Parents. Journal of Pediatric Ophthalmology & Strabismus 2024;61(2):148 View
  21. Sewunetie W, Kovács L. Exploring Sentence Parsing: OpenAI API-Based and Hybrid Parser-Based Approaches. IEEE Access 2024;12:38801 View
  22. Kaba E, Vogl T. RE: Accuracy of Large Language Models in Answering ESUR Guidelines on Contrast Media-Related Questions. Academic Radiology 2024;31(7):3073 View
  23. Caglayan A, Slusarczyk W, Rabbani R, Ghose A, Papadopoulos V, Boussios S. Large Language Models in Oncology: Revolution or Cause for Concern?. Current Oncology 2024;31(4):1817 View
  24. Huang Y, Wu R, He J, Xiang Y. Evaluating ChatGPT-4.0’s data analytic proficiency in epidemiological studies: A comparative analysis with SAS, SPSS, and R. Journal of Global Health 2024;14 View
  25. Cheng J. Applications of Large Language Models in Pathology. Bioengineering 2024;11(4):342 View
  26. Lin K, Chen T, Lin M, Chen Y, Chen T. Integration and Assessment of ChatGPT in Medical Case Reporting: A Multifaceted Approach. European Journal of Investigation in Health, Psychology and Education 2024;14(4):888 View
  27. Artsi Y, Sorin V, Konen E, Glicksberg B, Nadkarni G, Klang E. Large language models for generating medical examinations: systematic review. BMC Medical Education 2024;24(1) View
  28. Frank J, Merseburger A, Landmesser J, Brozat-Essen S, Schramm P, Freimann L, Kleehaus A, Elsner C. Large Language Modelle zur schnellen Vereinfachung der Eingabe von Qualitätssicherungsdaten: Performance-Test mit Echtdaten am Beispiel der Tumordokumentation in der Urologie. Aktuelle Urologie 2024;55(05):415 View
  29. Zheng Y, Stewart N. Improving EFL students’ cultural awareness: Reframing moral dilemmatic stories with ChatGPT. Computers and Education: Artificial Intelligence 2024;6:100223 View
  30. Payne D, Purohit K, Borrero W, Chung K, Hao M, Mpoy M, Jin M, Prasanna P, Hill V. Performance of GPT-4 on the American College of Radiology In-training Examination: Evaluating Accuracy, Model Drift, and Fine-tuning. Academic Radiology 2024;31(7):3046 View
  31. Braunheim D, Martin De Los Santos Kleinz L, Trierweiler L. Differences in source selection and their effect on the quality of written statements during a critical online reasoning performance assessment. Frontiers in Computer Science 2024;6 View
  32. Clark T, Fhaner M, Stoltzfus M, Queen M. Using ChatGPT to Support Lesson Planning for the Historical Experiments of Thomson, Millikan, and Rutherford. Journal of Chemical Education 2024;101(5):1992 View
  33. Chen J, Granet D. Further Reflections on the Use of Large Language Models in Pediatrics. JAMA Pediatrics 2024;178(6):629 View
  34. Yilmaz Muluk S. Enhancing Musculoskeletal Injection Safety: Evaluating Checklists Generated by Artificial Intelligence and Revising the Preformed Checklist. Cureus 2024 View
  35. Noda M, Yoshimura H, Okubo T, Koshu R, Uchiyama Y, Nomura A, Ito M, Takumi Y. Feasibility of Multimodal Artificial Intelligence Using GPT-4 Vision for the Classification of Middle Ear Disease: Qualitative Study and Validation. JMIR AI 2024;3:e58342 View
  36. Cesur T, Güneş Y. Optimizing Diagnostic Performance of ChatGPT: The Impact of Prompt Engineering on Thoracic Radiology Cases. Cureus 2024 View
  37. Venerito V, Lalwani D, Del Vescovo S, Iannone F, Gupta L. Prompt engineering: The next big skill in rheumatology research. International Journal of Rheumatic Diseases 2024;27(5) View
  38. Habib M, Hoodbhoy Z, Siddiqui M, Silva J. Knowledge, attitudes, and perceptions of healthcare students and professionals on the use of artificial intelligence in healthcare in Pakistan. PLOS Digital Health 2024;3(5):e0000443 View
  39. Perez-Lopez R, Ghaffari Laleh N, Mahmood F, Kather J. A guide to artificial intelligence for cancer researchers. Nature Reviews Cancer 2024;24(6):427 View
  40. Dos Santos F, Johnson L, Madandola O, Priola K, Yao Y, Macieira T, Keenan G. An example of leveraging AI for documentation: ChatGPT-generated nursing care plan for an older adult with lung cancer. Journal of the American Medical Informatics Association 2024;31(9):2089 View
  41. Laohawetwanit T, Apornvirat S, Kantasiripitak C. ChatGPT as a teaching tool: Preparing pathology residents for board examination with AI-generated digestive system pathology tests. American Journal of Clinical Pathology 2024 View
  42. Hassani H, Silva E. Predictions from Generative Artificial Intelligence Models: Towards a New Benchmark in Forecasting Practice. Information 2024;15(6):291 View
  43. Shukla A, Terziyan V, Tiihonen T. AI as a user of AI: Towards responsible autonomy. Heliyon 2024;10(11):e31397 View
  44. Wu Q, Wu Q, Li H, Wang Y, Bai Y, Wu Y, Yu X, Li X, Dong P, Xue J, Shen D, Wang M. Evaluating Large Language Models for Automated Reporting and Data Systems Categorization: Cross-Sectional Study. JMIR Medical Informatics 2024;12:e55799 View
  45. Leypold T, Lingens L, Beier J, Boos A. Integrating AI in Lipedema Management: Assessing the Efficacy of GPT-4 as a Consultation Assistant. Life 2024;14(5):646 View
  46. Wong K, Fayngersh A, Traba C, Cennimo D, Kothari N, Chen S. Using ChatGPT in the Development of Clinical Reasoning Cases: A Qualitative Study. Cureus 2024 View
  47. Collier Z, Gruss R, Abrahams A. How good are large language models at product risk assessment?. Risk Analysis 2024 View
  48. Sasson Lazovsky G, Raz T, Kenett Y. The Art of Creative Inquiry—From Question Asking to Prompt Engineering. The Journal of Creative Behavior 2024 View
  49. Brandt A. Amplifying the Anomaly: How Humans Choose Unproven Options and Large Language Models Avoid Them. Creativity Research Journal 2024:1 View
  50. Carius A, Teixeira A. Artificial Intelligence and content analysis: the large language models (LLMs) and the automatized categorization. AI & SOCIETY 2024 View
  51. Yao J, Aggarwal M, Lopez R, Namdari S. Large Language Models in Orthopaedics. Journal of Bone and Joint Surgery 2024;106(15):1411 View
  52. Maharjan J, Garikipati A, Singh N, Cyrus L, Sharma M, Ciobanu M, Barnes G, Thapa R, Mao Q, Das R. OpenMedLM: prompt engineering can out-perform fine-tuning in medical question-answering with open-source large language models. Scientific Reports 2024;14(1) View
  53. Stalp J, Denecke A, Jentschke M, Hillemanns P, Klapdor R. Quality of ChatGPT-Generated Therapy Recommendations for Breast Cancer Treatment in Gynecology. Current Oncology 2024;31(7):3845 View
  54. Wang J, Li J. Artificial intelligence empowering public health education: prospects and challenges. Frontiers in Public Health 2024;12 View
  55. Apornvirat S, Thinpanja W, Damrongkiet K, Benjakul N, Laohawetwanit T. Comparing customized ChatGPT and pathology residents in histopathologic description and diagnosis of common diseases. Annals of Diagnostic Pathology 2024;73:152359 View
  56. Miao Y, Luo Y, Zhao Y, Li J, Liu M, Wang H, Chen Y, Wu Y. Performance of GPT-4 on Chinese Nursing Examination. Nurse Educator 2024 View
  57. Li K, Fernandez A, Schwartz R, Rios N, Carlisle M, Amend G, Patel H, Breyer B. Comparing GPT-4 and Human Researchers in Health Care Data Analysis: Qualitative Description Study. Journal of Medical Internet Research 2024;26:e56500 View
  58. Oami T, Okada Y, Nakada T. Performance of a Large Language Model in Screening Citations. JAMA Network Open 2024;7(7):e2420496 View
  59. Kämmer J, Hautz W, Krummrey G, Sauter T, Penders D, Birrenbach T, Bienefeld N. Effects of interacting with a large language model compared with a human coach on the clinical diagnostic process and outcomes among fourth-year medical students: study protocol for a prospective, randomised experiment using patient vignettes. BMJ Open 2024;14(7):e087469 View
  60. Riaz I, Khan M, Haddad T. Potential application of artificial intelligence in cancer therapy. Current Opinion in Oncology 2024;36(5):437 View
  61. Tuttle J, Moshirfar M, Garcia J, Altaf A, Omidvarnia S, Hoopes P. Learning the Randleman Criteria in Refractive Surgery: Utilizing ChatGPT-3.5 Versus Internet Search Engine. Cureus 2024 View
  62. Liu H, Yin H, Luo Z, Wang X. Integrating chemistry knowledge in large language models via prompt engineering. Synthetic and Systems Biotechnology 2025;10(1):23 View
  63. Small W, Malhotra K, Major V, Wiesenfeld B, Lewis M, Grover H, Tang H, Banerjee A, Jabbour M, Aphinyanaphongs Y, Testa P, Austrian J, Hastings J. The First Generative AI Prompt-A-Thon in Healthcare: A Novel Approach to Workforce Engagement with a Private Instance of ChatGPT. PLOS Digital Health 2024;3(7):e0000394 View
  64. Patil R, Heston T, Bhuse V. Prompt Engineering in Healthcare. Electronics 2024;13(15):2961 View
  65. Naja F, Taktouk M, Matbouli D, Khaleel S, Maher A, Uzun B, Alameddine M, Nasreddine L. Artificial intelligence chatbots for the nutrition management of diabetes and the metabolic syndrome. European Journal of Clinical Nutrition 2024;78(10):887 View
  66. Leypold T, Schäfer B, Boos A, Beier J. Artificial Intelligence-Powered Hand Surgery Consultation: GPT-4 as an Assistant in a Hand Surgery Outpatient Clinic. The Journal of Hand Surgery 2024 View
  67. Prescott M, Yeager S, Ham L, Rivera Saldana C, Serrano V, Narez J, Paltin D, Delgado J, Moore D, Montoya J. Comparing the Efficacy and Efficiency of Human and Generative AI: Qualitative Thematic Analyses. JMIR AI 2024;3:e54482 View
  68. Heinke A, Radgoudarzi N, Huang B, Baxter S. A review of ophthalmology education in the era of generative artificial intelligence. Asia-Pacific Journal of Ophthalmology 2024;13(4):100089 View
  69. Kikuchi T, Nakao T, Nakamura Y, Hanaoka S, Mori H, Yoshikawa T. Toward Improved Radiologic Diagnostics: Investigating the Utility and Limitations of GPT-3.5 Turbo and GPT-4 with Quiz Cases. American Journal of Neuroradiology 2024 View
  70. Wang K, Pan Z, Lu Y. From general AI to custom AI: the effects of generative conversational AI’s cognitive and emotional conversational skills on user's guidance. Kybernetes 2024 View
  71. Tian Tran J, Burghall A, Blydt-Hansen T, Cammer A, Goldberg A, Hamiwka L, Johnson C, Kehler C, Phan V, Rosaasen N, Ruhl M, Strong J, Teoh C, Wichart J, Mansell H. Exploring the ability of ChatGPT to create quality patient education resources about kidney transplant. Patient Education and Counseling 2024;129:108400 View
  72. Urquhart E, Ryan J, Hartigan S, Nita C, Hanley C, Moran P, Bates J, Jooste R, Judge C, Laffey J, Madden M, McNicholas B. A pilot feasibility study comparing large language models in extracting key information from ICU patient text records from an Irish population. Intensive Care Medicine Experimental 2024;12(1) View
  73. Nananukul N, Sisaengsuwanchai K, Kejriwal M. Cost-efficient prompt engineering for unsupervised entity resolution in the product matching domain. Discover Artificial Intelligence 2024;4(1) View
  74. Pandya S, Bresler T, Wilson T, Htway Z, Fujita M. Decoding the NCCN Guidelines With AI: A Comparative Evaluation of ChatGPT-4.0 and Llama 2 in the Management of Thyroid Carcinoma. The American Surgeon™ 2024 View
  75. Vidhani D, Mariappan M. Optimizing Human–AI Collaboration in Chemistry: A Case Study on Enhancing Generative AI Responses through Prompt Engineering. Chemistry 2024;6(4):723 View
  76. Chen J, Reddy A, Al-Sharif E, Shoji M, Kalaw F, Eslani M, Lang P, Arya M, Koretz Z, Bolo K, Arnett J, Roginiel A, Do J, Robbins S, Camp A, Scott N, Rudell J, Weinreb R, Baxter S, Granet D. Analysis of ChatGPT Responses to Ophthalmic Cases: Can ChatGPT Think like an Ophthalmologist?. Ophthalmology Science 2025;5(1):100600 View
  77. Špecián P. Machine Advisors: Integrating Large Language Models Into Democratic Assemblies. Social Epistemology 2024:1 View
  78. Meskó B, Kristóf T, Dhunnoo P, Árvai N, Katonai G. Exploring the Need for Medical Futures Studies: Insights From a Scoping Review of Health Care Foresight. Journal of Medical Internet Research 2024;26:e57148 View
  79. Shah K, Xu A, Sharma Y, Daher M, McDonald C, Diebo B, Daniels A. Large Language Model Prompting Techniques for Advancement in Clinical Medicine. Journal of Clinical Medicine 2024;13(17):5101 View
  80. Yiannakoulias N. Spatial intelligence and contextual relevance in AI-driven health information retrieval. Applied Geography 2024;171:103392 View
  81. Wang J, Shi R, Le Q, Shan K, Chen Z, Zhou X, He Y, Hong J. Evaluating the effectiveness of large language models in patient education for conjunctivitis. British Journal of Ophthalmology 2024:bjo-2024-325599 View
  82. Quah B, Zheng L, Sng T, Yong C, Islam I. Reliability of ChatGPT in automated essay scoring for dental undergraduate examinations. BMC Medical Education 2024;24(1) View
  83. Urbina J, Vu P, Nguyen M. Disability Ethics and Education in the Age of Artificial Intelligence: Identifying Ability Bias in ChatGPT and Gemini. Archives of Physical Medicine and Rehabilitation 2024 View
  84. Fernández Cabrera A, García de Soto J, Santamaría Montero P, Chinea García H, Pego Reigosa R. NeuroGPT, evaluando ChatGPT: Diagnóstico y tratamiento de 72 pacientes neurológicos. Neurología Argentina 2024;16(3):136 View
  85. Nguyen D, MacKenzie A, Kim Y. Encouragement vs. liability: How prompt engineering influences ChatGPT-4's radiology exam performance. Clinical Imaging 2024;115:110276 View
  86. Leslie-Miller C, Simon S, Dean K, Mokhallati N, Cushing C. The critical need for expert oversight of ChatGPT: Prompt engineering for safeguarding child healthcare information. Journal of Pediatric Psychology 2024 View
  87. Schumacher I, Bühler V, Jaggi D, Roth J. Artificial intelligence derived large language model in decision-making process in uveitis. International Journal of Retina and Vitreous 2024;10(1) View
  88. Desseauve D, Lescar R, de la Fourniere B, Ceccaldi P, Dziadzko M. AI in obstetrics: Evaluating residents’ capabilities and interaction strategies with ChatGPT. European Journal of Obstetrics & Gynecology and Reproductive Biology 2024;302:238 View
  89. Geevarghese R, Sigel C, Cadley J, Chatterjee S, Jain P, Hollingsworth A, Chatterjee A, Swinburne N, Bilal K, Marinelli B. Extraction and classification of structured data from unstructured hepatobiliary pathology reports using large language models: a feasibility study compared with rules-based natural language processing. Journal of Clinical Pathology 2024:jcp-2024-209669 View
  90. Fuentealba Cid D, Flores-Fernández C, Aguilera Eguía R. The art of prompts' formulation: limitations, potential, and practical examples in large language models. Salud, Ciencia y Tecnología 2024;4 View
  91. Merlino D, Brufau S, Saieed G, Van Abel K, Price D, Archibald D, Ator G, Carlson M. Comparative Assessment of Otolaryngology Knowledge Among Large Language Models. The Laryngoscope 2024 View
  92. Quinn M, Milner J, Schmitt P, Morrissey P, Lemme N, Marcaccio S, DeFroda S, Tabaddor R, Owens B. Artificial Intelligence Large Language Models Address Anterior Cruciate Ligament Reconstruction: Superior Clarity and Completeness by Gemini Compared to ChatGPT-4 in Response to American Academy of Orthopedic Surgeons Clinical Practice Guidelines. Arthroscopy: The Journal of Arthroscopic & Related Surgery 2024 View
  93. Odabashian R. Evaluating the methodology: Enhancing prompt engineering in assessing ChatGPT’s research capabilities. Cancer Research, Statistics, and Treatment 2024;7(3):380 View
  94. Zhang C, Xu Q, Yu Y, Zhou G, Zeng K, Chang F, Ding K. A survey on potentials, pathways and challenges of large language models in new-generation intelligent manufacturing. Robotics and Computer-Integrated Manufacturing 2025;92:102883 View
  95. Kumari K, Pahuja S, Kumar S. A Comprehensive Examination of ChatGPT's Contribution to the Healthcare Sector and Hepatology. Digestive Diseases and Sciences 2024 View
  96. O'Malley A, Veenhuizen M, Ahmed A. Ensuring appropriate representation in AI-generated medical imagery: A Methodological Approach to Address Skin Tone Bias (Preprint). JMIR AI 2024 View
  97. Mohan C, Sathvik R, Kushal C, Kiran S, Ashok Kumar A. Exploring the Future of Prompt Engineering in Healthcare: Mission and Vision, Methods, Opportunities, Challenges, Issues and Their Remedies, Contributions, Advantages, Disadvantages, Applications, and Algorithms. Journal of The Institution of Engineers (India): Series B 2024 View
  98. Galli C, Cusano C, Meleti M, Donos N, Calciolari E. Topic Modeling for Faster Literature Screening Using Transformer-Based Embeddings. Metrics 2024;1(1):2 View
  99. McCoy L, Ci Ng F, Sauer C, Yap Legaspi K, Jain B, Gallifant J, McClurkin M, Hammond A, Goode D, Gichoya J, Celi L. Understanding and training for the impact of large language models and artificial intelligence in healthcare practice: a narrative review. BMC Medical Education 2024;24(1) View
  100. Anders B. Student skills need to evolve to match our new AI society. Patterns 2024;5(10):101062 View
  101. Sridharan K, Sivaramakrishnan G. Investigating the capabilities of advanced large language models in generating patient instructions and patient educational material. European Journal of Hospital Pharmacy 2024:ejhpharm-2024-004245 View
  102. Sujan M, Slater D, Crumpton E. How can large language models assist with a FRAM analysis?. Safety Science 2025;181:106695 View

Books/Policy Documents

  1. Hu Y, Kurylo A. The Role of Generative AI in the Communication Classroom. View
  2. Sarshartehrani F, Mohammadrezaei E, Behravan M, Gracanin D. Adaptive Instructional Systems. View
  3. Alter S. Enterprise, Business-Process and Information Systems Modeling. View
  4. Shan R, Youssef A. Intelligent Computer Mathematics. View
  5. Vakharia P, Kufeldt A, Meyers M, Lane I, Gilpin L. Neural-Symbolic Learning and Reasoning. View
  6. Arinushkina A, Abramov V, Mindzaeva E. Integration Strategies of Generative AI in Higher Education. View
  7. Ganguli S. Creative Approaches to Technology-Enhanced Learning for the Workplace and Higher Education. View