Published on in Vol 27 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/72412, first published .
Using Large Language Models to Assess the Consistency of Randomized Controlled Trials on AI Interventions With CONSORT-AI: Cross-Sectional Survey

Using Large Language Models to Assess the Consistency of Randomized Controlled Trials on AI Interventions With CONSORT-AI: Cross-Sectional Survey

Using Large Language Models to Assess the Consistency of Randomized Controlled Trials on AI Interventions With CONSORT-AI: Cross-Sectional Survey

Xufei Luo   1, 2, 3, 4, 5 * , MPH, PhD ;   Zeming Li   6 * , MSc ;   Zhenhua Yang   7 * , MSc ;   Bingyi Wang   1, 2, 3, 4, 5 , MPH ;   Yanfang Ma   7, 8 , MSc ;   Fengxian Chen   9 , PhD ;   Qi Wang   10, 11 , PhD ;   Long Ge   12 , PhD ;   James Zou   13, 14, 15 , PhD ;   Lu Zhang   6 , PhD ;   Yaolong Chen   1, 2, 3, 4, 5 , MD, PhD ;   Zhaoxiang Bian   7, 8 , MD, PhD

1 Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China

2 Research Unit of Evidence-Based Evaluation and Guidelines, Chinese Academy of Medical Sciences (2021RU017), School of Basic Medical Sciences, Lanzhou University, Lanzhou, China

3 World Health Organization Collaboration Center for Guideline Implementation and Knowledge Translation, Lanzhou, China

4 Institute of Health Data Science, Lanzhou University, Lanzhou, China

5 Key Laboratory of Evidence-Based Medicine of Gansu Province, Lanzhou University, Lanzhou, China

6 Department of Computer Science, Hong Kong Baptist University, Hong Kong, China (Hong Kong)

7 Vincent V.C. Woo Chinese Medicine Clinical Research Institute, School of Chinese Medicine, Hong Kong Baptist University, Hong Kong, China (Hong Kong)

8 Chinese EQUATOR Centre, Hong Kong, China (Hong Kong)

9 School of Information Science & Engineering, Lanzhou University, Lanzhou, China

10 School of Nursing, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China (Hong Kong)

11 Department of Health Research Methods, Evidence and Impact, Faculty of Health Sciences, McMaster University, Hamilton, ON, Canada

12 Department of Health Policy and Management, School of Public Health, Lanzhou University, Lanzhou, China

13 Department of Biomedical Data Science, Stanford University, Stanford, CA, United States

14 Department of Electrical Engineering, Stanford University, Stanford, CA, United States

15 Department of Computer Science, Stanford University, Stanford, CA, United States

*these authors contributed equally

Corresponding Author:

  • Yaolong Chen, MD, PhD
  • Evidence-Based Medicine Center, School of Basic Medical Sciences
  • Lanzhou University
  • 199 Donggang West Road, Chengguan District
  • Lanzhou 730000
  • China
  • Phone: 86 13893104140
  • Email: chevidence@lzu.edu.cn