Performance of Open-Source Large Language Models in Psychiatry: Usability Study Through Comparative Analysis of Non-English Records and English Translations

Min-Gyu Kim   ^{1, 2, 3 *} , MD ;   Gyubeom Hwang   ^{1, 2, 3 *} , MD ;   Junhyuk Chang   ^{1, 2, 4, 5 *} , PharmD ;   Seheon Chang   ⁶ ;   Hyun Woong Roh   ⁷ , MD, PhD ;   Rae Woong Park   ^{1, 2, 3, 4} , MD, PhD

¹ Department of Biomedical Informatics, Ajou University School of Medicine, Suwon, Republic of Korea

² Center for Biomedical Informatics Research, Ajou University Medical Cencer, Suown, Republic of Korea

³ Department of Medical Sciences, Graduate School of Ajou University, Suwon, Korea

⁴ BK21 R&E Initiative for Advanced Precision Medicine, Suwon, Republic of Korea

⁵ Department of Biomedical Sciences, Ajou University Graduate School of Medicine, Suwon, Republic of Korea

⁶ Department of Computer Science, The University of Texas at Austin, Austin, TX, United States

⁷ Department of Psychiatry, Ajou University School of Medicine, Suwon, Republic of Korea

*these authors contributed equally