Accessibility settings

This paper is in the following e-collection/theme issue:

Artificial Intelligence (2465) Research Instruments, Questionnaires, and Tools (807) Generative Language Models Including ChatGPT (890) AI Language Models in Health Care (291) Foundation Models and Their Applications in AI (66)

Published on in Vol 27 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/64452, first published .
Doctor and robot with clipboards in hospital hallway, representing AI in healthcare.

Performance of Large Language Models in Numerical Versus Semantic Medical Knowledge: Cross-Sectional Benchmarking Study on Evidence-Based Questions and Answers

Performance of Large Language Models in Numerical Versus Semantic Medical Knowledge: Cross-Sectional Benchmarking Study on Evidence-Based Questions and Answers

Authors of this article:

Eden Avnat1, 2 Author Orcid Image ;   Michal Levy3, 4 Author Orcid Image ;   Daniel Herstain1 Author Orcid Image ;   Elia Yanko5 Author Orcid Image ;   Daniel Ben Joya2, 6 Author Orcid Image ;   Michal Tzuchman Katz2 Author Orcid Image ;   Dafna Eshel2 Author Orcid Image ;   Sahar Laros1, 2 Author Orcid Image ;   Yael Dagan1, 2 Author Orcid Image ;   Shahar Barami1, 2 Author Orcid Image ;   Joseph Mermelstein2 Author Orcid Image ;   Shahar Ovadia2 Author Orcid Image ;   Noam Shomron1 Author Orcid Image ;   Varda Shalev1 Author Orcid Image ;   Raja-Elie E Abdulnour7 Author Orcid Image
Article Authors Cited by (3) Tweetations (2) Metrics

Journals

  1. Gong E, Bang C, Lee J, Baik G. Knowledge-Practice Performance Gap in Clinical Large Language Models: Systematic Review of 39 Benchmarks. Journal of Medical Internet Research 2025;27:e84120 View
  2. Gély L, Chaillot M, Fréour T. Can large language models provide accurate and empathetic answers to the most frequently asked questions by infertile patients? A pilot study. Reproductive BioMedicine Online 2026;52(4):105221 View
  3. Martini S, Schluessel S, Aghamaliyev U, Rippl M, Deissler L, Tausendfreund O, Nuebler D, Mueller K, Schmidmaier R, Drey M. Expert Evaluation of the Perceived Accuracy, Relevance, and Safety of Large Language Model–Generated Patient Information in Geriatrics: Cross-Condition Study. JMIR AI 2026;5:e91369 View