Accessibility settings

This paper is in the following e-collection/theme issue:

Generative Language Models Including ChatGPT (1695) Research Instruments, Questionnaires, and Tools (1257) New Methods (1896) Research Methodology - AI (219) Artificial Intelligence (AI) in Medical Education (917) AI Language Models in Health Care (873) Foundation Models and Their Applications in AI (131) Transparent Reporting (24) AI in Peer Review and Research Evaluation (9)

Published on in Vol 28 (2026)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/87057, first published .
Doctor using laptop with digital healthcare icons and vital signs overlay

The Alberta Quality Assessment Tool: Risk of Bias (AQAT:RoB) for the Evaluation of Medical Large Language Model Question-Answer Studies: Development and Pilot Validation

The Alberta Quality Assessment Tool: Risk of Bias (AQAT:RoB) for the Evaluation of Medical Large Language Model Question-Answer Studies: Development and Pilot Validation

Authors of this article:

Carrie Ye1, 2, 3 Author Orcid Image ;   Joseph Ross Mitchell1, 4 Author Orcid Image ;   Daniel C Baumgart1 Author Orcid Image ;   Zechen Ma1 Author Orcid Image ;   Angela Lim Fung1, 5 Author Orcid Image ;   Daniela Garcia Orellana1 Author Orcid Image ;   Juel Chowdhury1, 6 Author Orcid Image ;   Abdullah Abass1 Author Orcid Image ;   Steven Katz1, 7 Author Orcid Image ;   Jacob L Jaremko1 Author Orcid Image ;   Pierre Boulanger1 Author Orcid Image ;   Claire E H Barber8 Author Orcid Image ;   Gillian Lemermeyer1 Author Orcid Image ;   Hosna Jabbari1 Author Orcid Image ;   Lili Mou1, 4 Author Orcid Image ;   Maryam Mirzaei9 Author Orcid Image ;   Mary Waithera Beckett Githumbi5 Author Orcid Image ;   Puneeta Tandon1 Author Orcid Image ;   Randy Goebel1, 4 Author Orcid Image ;   Rhys Clark3 Author Orcid Image ;   Whitney Hung3 Author Orcid Image ;   Marjan Abbasi1 Author Orcid Image ;   Farhad Maleki8 Author Orcid Image ;   Scott Klarenbach1 Author Orcid Image ;   Mohamed Abdalla1, 4 Author Orcid Image
Article Authors Cited by (2) Tweetations Metrics

Journals

  1. Fung A, Abdalla M, Cheng Y, Elsayed M, Chojecki D, Mitchell J, Ye C. Systematic literature review and narrative synthesis of the use of natural language processing to triage outpatient referrals. Frontiers in Health Services 2026;6 View
  2. Kremer P, Haase I, Boyadzhieva Z, Krusche M. Large language models in rheumatology: applications, methodological quality and clinical translation – a systematic review. RMD Open 2026;12(4):e007538 View