Development and Pilot Evaluation of a Standardized and Accessible Rubric (OMNI) for Assessing Generative AI in Health Care Contexts: Four-Stage Mixed Methods Study

Erik Cornelisse   ¹ , MPharm ;   Dib Kousa   ¹ , BPharm ;   Bradley D Menz   ¹ , PhD ;   Brinleigh Murphy-Reuter   ² , EdM ;   Adel Shahnam   ³ , MD ;   Benjamin Chin-Yee   ⁴ , MD, PhD ;   Ryan Calabro   ⁵ , PhD ;   Lee X Li   ¹ , MBIOSTAT ;   Imogen Ramsey   ⁶ , PhD ;   Ahmad Y Abuhelwa   ⁷ , PhD ;   Jessica M Logan   ⁸ , PhD ;   Huah Shin Ng   ¹ , PhD ;   Mythily Aravinthan   ⁹ , MBBS, MD ;   James Goonan   ⁹ , MBBS ;   Hannah Carthew   ⁹ , MBBS ;   Paul Molyneux   ¹⁰ , MBBS ;   Joanne Tang   ¹¹ , MBBS ;   Nadia Hitchen   ^{12, 13} , MBBS ;   Martin Hong   ¹⁴ , MBBS ;   Jimit Gandhi   ^{8, 15} , BPharm ;   Stephanie Fontanarosa   ¹⁵ , BPharm ;   Nicholas L Scarfo   ¹⁵ , BPharm ;   Kezia Daniel   ¹⁵ , MClinPharm ;   Sally B Marotti   ^{1, 8, 15} , MClinPharm ;   Joy Mariadas   ¹ , MBBS, MD ;   Bianca van Diermen   ¹⁰ , MD ;   Divya Joyce Susai Manickam   ⁹ , MBBS ;   Warit Ruanglertboon   ^{16, 17} , PhD ;   David Postma   ¹ , MSc ;   Melissa D McCradden   ^{18, 19, 20} , PhD ;   Sandeep Reddy   ²¹ , PhD ;   Stephen Bacchi   ^{1, 22} , MBBS, PhD ;   Arduino A Mangoni   ^{1, 23} , MD, PhD ;   Ross A McKinnon   ¹ , PhD ;   Ganessan Kichenadasse   ^{1, 24} , MD, PhD ;   Gary H Lyman   ^{25, 26} , MD, MPH ;   Nicole M Kuderer   ²⁷ , MD ;   Michael J Sorich   ¹ , PhD ;   Andrew Rowland   ¹ , PhD ;   Ashley M Hopkins   ¹ , PhD

¹ College of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, South Australia, Australia

² Science to People, Inc, Lexington, MA, United States

³ Memorial Sloan Kettering Cancer Center, New York, NY, United States

⁴ Schulich School of Medicine and Dentistry, Western University, London, ON, Canada

⁵ Cancer Council South Australia, Adelaide, South Australia, Australia

⁶ Caring Futures Institute, College of Health and Enablement, Flinders University, Adelaide, South Australia, Australia

⁷ Department of Pharmacy Practice and Pharmacotherapeutics, College of Pharmacy, University of Sharjah, Sharjah, United Arab Emirates

⁸ School of Pharmacy and Biomedical Science, College of Health, Adelaide University, Adelaide, South Australia, Australia

⁹ Flinders Medical Centre, Southern Adelaide Local Health Network, Adelaide, South Australia, Australia

¹⁰ Chandlers Hill Surgery, Adelaide, South Australia, Australia

¹¹ Lyell McEwin Hospital, Northern Adelaide Local Health Network, Adelaide, South Australia, Australia

¹² Department of Oncology, Sir Peter MacCallum Cancer Centre, Melbourne, Victoria, Australia

¹³ Department of Medical Oncology, Peter MacCallum Cancer Centre, Melbourne, Victoria, Australia

¹⁴ South Western Sydney Local Health District, Sydney, New South Wales, Australia

¹⁵ SA Pharmacy, SA Health, Adelaide, South Australia, Australia

¹⁶ Discipline of Pharmacology, Division of Health and Applied Sciences, Faculty of Science, Prince of Songkla University, Hat Yai, Songkhla, Thailand

¹⁷ Research Center in Mathematics and Statistics with Applications, Faculty of Science, Prince of Songkla University, Hat Yai, Songkhla, Thailand

¹⁸ Australian Institute for Machine Learning, Adelaide University, Adelaide, South Australia, Australia

¹⁹ SickKids Research Institute, Toronto, ON, Canada

²⁰ Women's and Children's Health Network, Adelaide, South Australia, Australia

²¹ School of Public Health and Social Work, Queensland University of Technology, Brisbane, Queensland, Australia

²² School of Medicine, Adelaide University, Adelaide, South Australia, Australia

²³ Department of Clinical Pharmacology, Flinders Medical Centre, Southern Adelaide Local Health Network, Adelaide, South Australia, Australia

²⁴ Department of Medical Oncology, Flinders Centre for Innovation in Cancer, Flinders University, Adelaide, South Australia, Australia

²⁵ Division of Public Health Sciences, Fred Hutch Cancer Center, Seattle, WA, United States

²⁶ Division of Medical Oncology, School of Medicine, Duke University, Durham, NC, United States

²⁷ Advanced Cancer Research Group, Kirkland, WA, United States