Published on in Vol 22, No 10 (2020): October

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/20891, first published .
Federated Learning on Clinical Benchmark Data: Performance Assessment

Federated Learning on Clinical Benchmark Data: Performance Assessment

Federated Learning on Clinical Benchmark Data: Performance Assessment

Authors of this article:

Geun Hyeong Lee1 Author Orcid Image ;   Soo-Yong Shin1, 2, 3 Author Orcid Image

Journals

  1. Mazzeo V, Rapisarda A, Giuffrida G. Detection of Fake News on COVID-19 on Web Search Engines. Frontiers in Physics 2021;9 View
  2. Abreha H, Hayajneh M, Serhani M. Federated Learning in Edge Computing: A Systematic Survey. Sensors 2022;22(2):450 View
  3. Budrionis A, Miara M, Miara P, Wilk S, Bellika J. Benchmarking PySyft Federated Learning Framework on MIMIC-III Dataset. IEEE Access 2021;9:116869 View
  4. Nakagawa K, Moukheiber L, Celi L, Patel M, Mahmood F, Gondim D, Hogarth M, Levenson R. AI in Pathology: What could possibly go wrong?. Seminars in Diagnostic Pathology 2023;40(2):100 View
  5. Ng W, Zhang S, Wang Z, Ong C, Gunasekeran D, Lim G, Zheng F, Tan S, Tan G, Rim T, Schmetterer L, Ting D. Updates in deep learning research in ophthalmology. Clinical Science 2021;135(20):2357 View
  6. Drainakis G, Pantazopoulos P, Katsaros K, Sourlas V, Amditis A, Kaklamani D. From centralized to Federated Learning: Exploring performance and end-to-end resource consumption. Computer Networks 2023;225:109657 View
  7. Yoon J, Pinsky M, Clermont G. Artificial Intelligence in Critical Care Medicine. Critical Care 2022;26(1) View
  8. He S, Leanse L, Feng Y. Artificial intelligence and machine learning assisted drug delivery for effective treatment of infectious diseases. Advanced Drug Delivery Reviews 2021;178:113922 View
  9. Zhang L, Vashisht H, Totev A, Trinh N, Ward T. A comparison of distributed machine learning methods for the support of “many labs” collaborations in computational modeling of decision making. Frontiers in Psychology 2022;13 View
  10. Oh W, Nadkarni G. Federated Learning in Health care Using Structured Medical Data. Advances in Kidney Disease and Health 2023;30(1):4 View
  11. Zhu X, Wang D, Pedrycz W, Li Z. Horizontal Federated Learning of Takagi–Sugeno Fuzzy Rule-Based Models. IEEE Transactions on Fuzzy Systems 2022;30(9):3537 View
  12. Chen X, Cheng G, Wang F, Tao X, Xie H, Xu L. Machine and cognitive intelligence for human health: systematic review. Brain Informatics 2022;9(1) View
  13. Li H, Li C, Wang J, Yang A, Ma Z, Zhang Z, Hua D. Review on security of federated learning and its application in healthcare. Future Generation Computer Systems 2023;144:271 View
  14. Sáinz-Pardo Díaz J, López García Á. Study of the performance and scalability of federated learning for medical imaging with intermittent clients. Neurocomputing 2023;518:142 View
  15. Zanotto B, Beck da Silva Etges A, dal Bosco A, Cortes E, Ruschel R, De Souza A, Andrade C, Viegas F, Canuto S, Luiz W, Ouriques Martins S, Vieira R, Polanczyk C, André Gonçalves M. Stroke Outcome Measurements From Electronic Medical Records: Cross-sectional Study on the Effectiveness of Neural and Nonneural Classifiers. JMIR Medical Informatics 2021;9(11):e29120 View
  16. Zheng Z, Zhou Y, Sun Y, Wang Z, Liu B, Li K. Applications of federated learning in smart cities: recent advances, taxonomy, and open challenges. Connection Science 2022;34(1):1 View
  17. Sun L, Wu J. A Scalable and Transferable Federated Learning System for Classifying Healthcare Sensor Data. IEEE Journal of Biomedical and Health Informatics 2023;27(2):866 View
  18. Ogundokun R, Misra S, Maskeliunas R, Damasevicius R. A Review on Federated Learning and Machine Learning Approaches: Categorization, Application Areas, and Blockchain Technology. Information 2022;13(5):263 View
  19. Yu B, Mao W, Lv Y, Zhang C, Xie Y. A survey on federated learning in data mining. WIREs Data Mining and Knowledge Discovery 2022;12(1) View
  20. Naresh V, Thamarai M. Privacy‐preserving data mining and machine learning in healthcare: Applications, challenges, and solutions. WIREs Data Mining and Knowledge Discovery 2023;13(2) View
  21. Lim J, Hong M, Lam W, Zhang Z, Teo Z, Liu Y, Ng W, Foo L, Ting D. Novel technical and privacy-preserving technology for artificial intelligence in ophthalmology. Current Opinion in Ophthalmology 2022;33(3):174 View
  22. Zhang J, Zhu H, Wang F, Zhao J, Xu Q, Li H, Wang Z. Security and Privacy Threats to Federated Learning: Issues, Methods, and Challenges. Security and Communication Networks 2022;2022:1 View
  23. Al-Huthaifi R, Li T, Huang W, Gu J, Li C. Federated learning in smart cities: Privacy and security survey. Information Sciences 2023;632:833 View
  24. Zhu J, Luo J, Ma Y. Screening of serum exosome markers for colorectal cancer based on Boruta and multi-cluster feature selection algorithms. Molecular & Cellular Toxicology 2024;20(2):343 View
  25. Bozkurt C, Aşuroğlu T. Mortality Prediction of Various Cancer Patients via Relevant Feature Analysis and Machine Learning. SN Computer Science 2023;4(3) View
  26. Chaddad A, Lu Q, Li J, Katib Y, Kateb R, Tanougast C, Bouridane A, Abdulkadir A. Explainable, Domain-Adaptive, and Federated Artificial Intelligence in Medicine. IEEE/CAA Journal of Automatica Sinica 2023;10(4):859 View
  27. Brauneck A, Schmalhorst L, Kazemi Majdabadi M, Bakhtiari M, Völker U, Baumbach J, Baumbach L, Buchholtz G. Federated Machine Learning, Privacy-Enhancing Technologies, and Data Protection Laws in Medical Research: Scoping Review. Journal of Medical Internet Research 2023;25:e41588 View
  28. Shen A, Francisco L, Sen S, Tewari A. Exploring the Relationship Between Privacy and Utility in Mobile Health: Algorithm Development and Validation via Simulations of Federated Learning, Differential Privacy, and External Attacks. Journal of Medical Internet Research 2023;25:e43664 View
  29. Lee G, Park J, Kim J, Kim Y, Choi B, Park R, Rhee S, Shin S. Feasibility Study of Federated Learning on the Distributed Research Network of OMOP Common Data Model. Healthcare Informatics Research 2023;29(2):168 View
  30. Khan Q, Khan A, Rizwan A, Ahmad R, Khan S, Kim D. Decentralized Machine Learning Training: A Survey on Synchronization, Consolidation, and Topologies. IEEE Access 2023;11:68031 View
  31. Takahashi K, Yamamoto K, Kuchiba A, Shintani A, Koyama T. Hypothesis testing procedure for binary and multi‐class F1‐scores in the paired design. Statistics in Medicine 2023;42(23):4177 View
  32. Navaz A, Serhani M, El Kassabi H, Taleb I. Empowering Patient Similarity Networks through Innovative Data-Quality-Aware Federated Profiling. Sensors 2023;23(14):6443 View
  33. Mali B, Saha S, Brahma D, Pinninti R, Singh P. Towards Building a Global Robust Model for Heart Disease Detection. SN Computer Science 2023;4(5) View
  34. Liang X, Zhao J, Chen Y, Bandara E, Shetty S. Architectural Design of a Blockchain-Enabled, Federated Learning Platform for Algorithmic Fairness in Predictive Health Care: Design Science Study. Journal of Medical Internet Research 2023;25:e46547 View
  35. Liu Y. Depression clinical detection model based on social media: a federated deep learning approach. The Journal of Supercomputing 2024;80(6):7931 View
  36. Zhang N, Ma Q, Chen X. Enabling Long-Term Cooperation in Cross-Silo Federated Learning: A Repeated Game Perspective. IEEE Transactions on Mobile Computing 2023;22(7):3910 View
  37. Luo G, Liu T, Lu J, Chen X, Yu L, Wu J, Chen D, Cai W. Influence of Data Distribution on Federated Learning Performance in Tumor Segmentation. Radiology: Artificial Intelligence 2023;5(3) View
  38. Chang H, Yu J, Lee G, Heo S, Lee S, Hwang S, Yoon H, Cha W, Shin T, Sim M, Jo I, Kim T. Clinical support system for triage based on federated learning for the Korea triage and acuity scale. Heliyon 2023;9(8):e19210 View
  39. Naresh V, Thamarai M, Allavarpu V. Privacy-preserving deep learning in medical informatics: applications, challenges, and solutions. Artificial Intelligence Review 2023;56(S1):1199 View
  40. Matschinske J, Späth J, Bakhtiari M, Probul N, Kazemi Majdabadi M, Nasirigerdeh R, Torkzadehmahani R, Hartebrodt A, Orban B, Fejér S, Zolotareva O, Das S, Baumbach L, Pauling J, Tomašević O, Bihari B, Bloice M, Donner N, Fdhila W, Frisch T, Hauschild A, Heider D, Holzinger A, Hötzendorfer W, Hospes J, Kacprowski T, Kastelitz M, List M, Mayer R, Moga M, Müller H, Pustozerova A, Röttger R, Saak C, Saranti A, Schmidt H, Tschohl C, Wenke N, Baumbach J. The FeatureCloud Platform for Federated Learning in Biomedicine: Unified Approach. Journal of Medical Internet Research 2023;25:e42621 View
  41. Zukaib U, Cui X, Hassan M, Harris S, Hadi H, Zheng C. Blockchain and Machine Learning in EHR Security: A Systematic Review. IEEE Access 2023;11:130230 View
  42. Tran A, Luong T, Huynh V. A comprehensive survey and taxonomy on privacy-preserving deep learning. Neurocomputing 2024;576:127345 View
  43. Paragliola G, Ribino P. Exploring heterogeneous data distribution issues in e-health federated systems. Biomedical Signal Processing and Control 2024;92:106039 View
  44. Kjwan A, Mohammad O. Enhancing Medical Data Analysis with Federated Learning in the Internet of Medical Things. International Journal of Research In Science & Engineering 2024;(43):38 View
  45. Coutinho-Almeida J, Cruz-Correia R, Rodrigues P. Evaluating distributed-learning on real-world obstetrics data: comparing distributed, centralized and local models. Scientific Reports 2024;14(1) View
  46. Saha S, Hota A, Chattopadhyay A, Nag A, Nandi S. A multifaceted survey on privacy preservation of federated learning: progress, challenges, and opportunities. Artificial Intelligence Review 2024;57(7) View
  47. Grzybowski A, Jin K, Zhou J, Pan X, Wang M, Ye J, Wong T. Retina Fundus Photograph-Based Artificial Intelligence Algorithms in Medicine: A Systematic Review. Ophthalmology and Therapy 2024;13(8):2125 View
  48. Mishra S, Chaudhury P, Tripathy H, Sahoo K, Jhanjhi N, Hassan Elnour A, Abdelmaboud A. Enhancing health care through medical cognitive virtual agents. DIGITAL HEALTH 2024;10 View
  49. Morar C, Popescu D. A Survey of Blockchain Applicability, Challenges, and Key Threats. Computers 2024;13(9):223 View
  50. Shin H, Ryu K, Kim J, Lee S. Application of privacy protection technology to healthcare big data. DIGITAL HEALTH 2024;10 View
  51. Wen X, Wang Y, Yuan M, Geng Y, Yu H, Zheng G. Enhancing Human Activity Recognition With FedPA: Focusing on Non-IID Data Challenges in Federated Learning. IEEE Sensors Journal 2024;24(23):39230 View
  52. Weimann K, Conrad T. Federated Learning With Deep Neural Networks: A Privacy-Preserving Approach to Enhanced ECG Classification. IEEE Journal of Biomedical and Health Informatics 2024;28(11):6931 View
  53. Panda S, Dubey R, Jena B, Pareek V, Tsai L, Saxena S. Federated learning frameworks in smart e-healthcare: A systematic literature review with bias evaluation. Applied Soft Computing 2025;171:112747 View
  54. Hu F, Qiu S, Yang X, Wu C, Nunes M, Chen H. Privacy-Preserving Healthcare and Medical Data Collaboration Service System Based on Blockchain and Federated Learning. Computers, Materials & Continua 2024;80(2):2897 View
  55. Vajrobol V, Singh S, Saxena G, Pundir A, Gaurav A, Bansal S, Attar R, Rahman M, Gupta B. A Comprehensive Survey on Federated Learning Applications in Computational Mental Healthcare. Computer Modeling in Engineering & Sciences 2025;142(1):49 View
  56. Rishu ., Kukreja V, Hariharan S, Dogra A, Goyal B. Information Modeling Technique to Decipher Research Trends of Federated Learning in Healthcare. The Open Neuroimaging Journal 2025;18(1) View
  57. Vaijainthymala Krishnamoorthy M. Data Obfuscation Through Latent Space Projection for Privacy-Preserving AI Governance: Case Studies in Medical Diagnosis and Finance Fraud Detection. JMIRx Med 2025;6:e70100 View
  58. Wrona A, Atanasious M, Delli Priscoli F. Deep Reinforcement Learning-based Automatic Augmentation for Gastrointestinal Disease Classification. ACM Transactions on Computing for Healthcare 2025;6(3):1 View
  59. Kapsecker M, Jonas S, Tsaneva-Atanasova K. Cross-device federated unsupervised learning for the detection of anomalies in single-lead electrocardiogram signals. PLOS Digital Health 2025;4(4):e0000793 View
  60. Nguyen D, Imami M, Zhao L, Wu J, Borhani A, Mohseni A, Khunte M, Zhong Z, Shi V, Yao S, Wang Y, Loizou N, Silva A, Zhang P, Zhang Z, Jiao Z, Kamel I, Liao W, Bai H. Federated Learning for Renal Tumor Segmentation and Classification on Multi‐Center MRI Dataset. Journal of Magnetic Resonance Imaging 2025;62(3):814 View
  61. Priya Natarajan H. Privacy Preserving Federated Reinforcement Imitation Learning Framework With Robust Aggregation for Cloud‐Based Domestic Robots. Concurrency and Computation: Practice and Experience 2025;37(15-17) View
  62. Lin X, Zhao X, Yin Z, Pan H, Jing P, Li W, Wang K, Shu Y. Knowledge-driven federated learning: A systematic literature review on approaches, challenges, and prospects. The Journal of Supercomputing 2025;81(8) View
  63. Oh S, Choi Y, Joo H, Kim K. Federated Reinforcement Learning for Privacy-Preserving Sepsis Patient Treatment Model. ACM Transactions on Intelligent Systems and Technology 2025 View
  64. Pantelis A, Epiphaniou P, Lapatsanis D. Machine learning and artificial intelligence for predicting short and long-term complications following metabolic bariatric surgery - a systematic review. Artificial Intelligence Surgery 2025;5(3):322 View
  65. Park Y, Beck S, Lee Y. Perceptions and Willingness of Patients and Caregivers on the Utilization of Patient-Generated Health Data: A Cross-Sectional Survey. International Journal of Environmental Research and Public Health 2025;22(7):1099 View
  66. Udokwu C, Voicu-Dorobanțu R, Ogunyemi A, Norta A, Sturua N, Craß S. Leveraging Blockchain for Ethical AI: Mitigating Digital Threats and Strengthening Societal Resilience. Future Internet 2025;17(7):309 View
  67. Tahir N, Jung C, Lee S, Azizah N, Ho W, Li T. Federated Learning-Based Model for Predicting Mortality: Systematic Review and Meta-Analysis. Journal of Medical Internet Research 2025;27:e65708 View
  68. Abbas Z, Ahmad S, Anjum A, Syed M, Malik S, Rehman S. Ensuring Zero Trust in GDPR-Compliant Deep Federated Learning Architecture. Computers 2025;14(8):317 View
  69. Chung C, Chou S, Kao C, Chen Y, Hsiao T, Chen Y. Application of machine learning algorithm for the prediction of lupus nephritis using SNP data, polygenic risk score, and electronic health record. Health Informatics Journal 2025;31(3) View
  70. Puca P, Lopetuso L, Laterza L, Papa A, Danese S, Cesario A, Damiani A, Gasbarrini A, Arcuri G, Scaldaferri F. Federated learning in inflammatory bowel disease: The future of privacy-preserving Artificial Intelligence. Best Practice & Research Clinical Gastroenterology 2025;78:102050 View
  71. Demuth S, Rousseau O, Faddeenkov I, Paris J, De Sèze J, Baciotti B, Payet M, Guillaudeux M, Barreteau A, Laplaud D, Edan G, Gourraud P. Privacy-by-Design Approach to Generate Two Virtual Clinical Trials for Multiple Sclerosis and Release Them as Open Datasets: Evaluation Study. Journal of Medical Internet Research 2025;27:e71297 View
  72. Zeng X, Ahmed A, Tunio M. Exploring Uncertainty in Medical Federated Learning: A Survey. Electronics 2025;14(20):4072 View
  73. Jerang R, Mahato G, Banerjee A, Chakraborty S. Blockchain-Enhanced Homomorphic Encryption for Neuro-Signal Driven Collaborative Intelligence in Secure Adaptive Learning Environments. IETE Journal of Research 2025:1 View

Books/Policy Documents

  1. Van Landuyt D, Joosen W. Software Architecture. View
  2. Yoon J, Pinsky M, Clermont G. Annual Update in Intensive Care and Emergency Medicine 2022. View
  3. Ramesh V, S. H, Sundaram S, N. B. P, G. R. H. Handbook of Research on Design, Deployment, Automation, and Testing Strategies for 6G Mobile Core Network. View
  4. Singh A, Kumar A, Choi B. Intelligent Human Computer Interaction. View
  5. Georgoutsos A, Kerasiotis P, Kantere V. Web Information Systems Engineering – WISE 2023. View
  6. Guerra-Manzanares A, Lopez L, Maniatakos M, Shamout F. Trustworthy Machine Learning for Healthcare. View
  7. Hannemann A, Ewald J, Seeger L, Buchmann E. Computational Science – ICCS 2024. View
  8. Canelas-Pais M, Coutinho Almeida J, Magalhães Araujo S, Maia Rafael F, Cruz-Correia R, Pereira Rodrigues P. Artificial Intelligence for Drug Product Lifecycle Applications. View
  9. Garst S, Reinders M. Pattern Recognition. View
  10. Mondrejevski L, Azzopardi D, Miliou I. Machine Learning and Principles and Practice of Knowledge Discovery in Databases. View
  11. Negrão A, Silva G, Pedrosa R, Luz E, Silva P. Intelligent Systems. View

Conference Proceedings

  1. El Kassabi H, Adel Serhani M, Navaz A, Ouhbi S. 2021 IEEE/ACS 18th International Conference on Computer Systems and Applications (AICCSA). Federated Patient Similarity Network for Data-Driven Diagnosis of COVID-19 Patients View
  2. Kamble V, Phophalia A. 2022 IEEE 10th Region 10 Humanitarian Technology Conference (R10-HTC). Medical Image Analysis Using Federated Learning Frameworks: Technical Review View
  3. Zhang T, Zhang S, Chen Z, Bengio Y, Liu D. 2022 IEEE International Conference on Big Data (Big Data). PMFL: Partial Meta-Federated Learning for heterogeneous tasks and its applications on real-world medical records View
  4. Dolo B, Loukil F, Boukadi K. 2022 IEEE/ACS 19th International Conference on Computer Systems and Applications (AICCSA). Early Detection of Diabetes Mellitus Using Differentially Private SGD in Federated Learning View
  5. Mondrejevski L, Miliou I, Montanino A, Pitts D, Hollmen J, Papapetrou P. 2022 IEEE 35th International Symposium on Computer-Based Medical Systems (CBMS). FLICU: A Federated Learning Workflow for Intensive Care Unit Mortality Prediction View
  6. Kim W, Seok J. 2022 International Conference on Artificial Intelligence in Information and Communication (ICAIIC). Privacy-preserving collaborative machine learning in biomedical applications View
  7. Moon S, Hee Lee W. 2023 International Conference on Electronics, Information, and Communication (ICEIC). Privacy-Preserving Federated Learning in Healthcare View
  8. Sarlas A, Kalafatelis A, Alexandridis G, Kourtis M, Trakadas P. Proceedings of the 18th International Conference on Availability, Reliability and Security. Exploring Federated Learning for Speech-based Parkinson’s Disease Detection View
  9. Elhussein A, Megjhani M, Nametz D, Weiss M, Savarraj J, Kwon S, Roh D, Agarwal S, Connolly E, Velazquez A, Claassen J, Choi H, Schubert G, Park S, Gürsoy G. 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). A generalizable physiological model for detection of Delayed Cerebral Ischemia using Federated Learning View
  10. Ali F, Kulkarni A, Hussain S, Mhatre N. 2024 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI). Federated Learning for Enhanced Performance on Decentralized Healthcare Datasets View
  11. Aasoum N, Jellouli I, Amjad S, Mohammed Y. 2024 4th International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET). Security and Privacy-Preserving Techniques of Federated Learning in Edge Computing: A Comparative Study View
  12. Seneviratne O. 2024 IEEE 12th International Conference on Healthcare Informatics (ICHI). Decentralized, Explainable, and Personalized Mental Health Monitoring View
  13. Chen T, Wang F, Qiu W, Zhang Q, Xiong Z, Zheng Z. 2024 IEEE 44th International Conference on Distributed Computing Systems (ICDCS). Toward Free-Riding Attack on Cross-Silo Federated Learning Through Evolutionary Game View
  14. Bornstein M, Nazir N, Drgona J, Kundu S, Adetola V. Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. Finding MIDDLE Ground: Scalable and Secure Distributed Learning View
  15. le G T, Pham G N, G P, Minh Dang D. 2024 15th International Conference on Information and Communication Technology Convergence (ICTC). Federated Learning with U-Net for Brain Tumor Segmentation: Impact of Client Numbers and Data Distribution View
  16. Saranya K, Valarmathi A. 2024 4th International Conference on Ubiquitous Computing and Intelligent Information Systems (ICUIS). Securing Medical Data in Cloud-Based IoT Networks Using Deep Learning Techniques View
  17. Bhaskar D, B M, V P B. 2025 Emerging Technologies for Intelligent Systems (ETIS). Securing Diabetic Prediction with Federated Learning and Homomorphic Encryption View
  18. Deng B. 2025 IEEE 6th International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT). Fair Contribution Evaluation in Federated Learning for Medical Image Analysis Using the Banzhaf Index View
  19. Georgiades M, Christodoulou L, Chari A, Wang K, Ho K, Hou Y, Chai W. 2025 21st International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT). Federated Learning for Early Cardiac Anomaly Prediction in Cross-Silo IoMT Environments View
  20. Yadav S, Bor-Yaliniz I. 2024 IEEE Globecom Workshops (GC Wkshps). BACSA: A Bias-Aware Client Selection Algorithm for Privacy-Preserving Federated Learning in Wireless Healthcare Networks View
  21. Georgoutsos A, Kerasiotis P, Kantere V. 35th International Conference on Scientific and Statistical Database Management. Early ICU Mortality Prediction with Deep Federated Learning: A Real-World Scenario View