Improving Retrieval Augmented Generation for Health Care by Fine-Tuning Clinical Embedding Models: Development and Evaluation Study

Kamyar Arzideh   ^{1, 2} , MSc ;   Henning Schäfer   ^{1, 3} , PhD ;   Ahmad Idrissi-Yaghir   ^{1, 4} , MSc ;   Cynthia Sabrina Schmidt   ^{1, 3, 5} , MD ;   Bahadir Eryilmaz   ¹ , MSc ;   Mikel Bahn   ¹ , MSc ;   Amin T Turki   ^{1, 6} , MD, PhD ;   Olivia Barbara Pollok   ⁴ , MD ;   Eva Maria Hartmann   ^{1, 2} , MSc ;   Philipp Winnekens   ² , MSc ;   Katarzyna Borys   ^{1, 4} , MSc ;   Johannes Haubold   ^{1, 4} , Prof Dr Med ;   Felix Nensa   ^{1, 4} , Prof Dr Med ;   René Hosch   ^{1, 4} , PhD

¹ Institute for Artificial Intelligence in Medicine,, University Hospital Essen, Essen, Germany

² Central IT Department, Data Integration Center, University Hospital Essen, Essen, Germany

³ Institute for Transfusion Medicine, University Hospital Essen, Essen, Germany

⁴ Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Essen, Germany

⁵ Center of Sleep and Telemedicine, University Hospital Essen, Ruhrlandklinik, Essen, Germany

⁶ Department of Hematology and Oncology, Ruhr-University Bochum, Marienhospital University Hospital, Bochum, Germany