Accessibility settings

This paper is in the following e-collection/theme issue:

Formative Evaluation of Digital Health Interventions (5513) e-Learning and Digital Medical Education (1698) Testing and Assessment in Medical Education (255) Chatbots and Conversational Agents (1265) Artificial Intelligence (5152) Artificial Intelligence (AI) in Medical Education (924) Generative Language Models Including ChatGPT (1700)

Published on in Vol 9 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/77357, first published .
Laptop screen displaying ChatGPT interface with examples and limitations

Performance of DeepSeek-R1, ChatGPT (GPT-o3-mini), and Gemini 2.0 Flash on German Medical Multiple-Choice Questions: Comparative Evaluation

Performance of DeepSeek-R1, ChatGPT (GPT-o3-mini), and Gemini 2.0 Flash on German Medical Multiple-Choice Questions: Comparative Evaluation

Authors of this article:

Annika Meyer1 Author Orcid Image ;   Yassin Karay2 Author Orcid Image ;   Andrea U Steinbicker1 Author Orcid Image ;   Thomas Streichert3 Author Orcid Image ;   Remco Overbeek1 Author Orcid Image
Article Authors Cited by (9) Tweetations Metrics

Journals

  1. Xu H, Chen P, Luo Z, Chen Y, He P, Tan Y. “Is GenAI my supervisor?” Experiences of nursing undergraduates in using generative AI to assist in case study theses: A qualitative study. Nurse Education Today 2026;162:107053 View
  2. Chen Y, Tao J, Chen G, Yan B, Chen C, Liang R, Cheng Z, Hou L. Will artificial intelligence challenge human in innovative works?– a perspective in environmental research. Carbon Neutral Systems 2026;2(1) View
  3. Wang Z, Ma Y, Peng S, Gao J, Khajorntraidet C, Huang Y, Chen H. Multi-agent data cleaning framework of solid-state batteries using large language models. Green Energy and Intelligent Transportation 2026;5(6):100401 View
  4. Prabha S, Collaco B, Gomez-Cabello C, Haider S, Genovese A, Fang Z, Wood N, Bagaria S, Tao C, Forte A. Fine-Tuning, Retrieval-Augmented Generation, and Hybrid Large Language Models for Postoperative Decision Support: Comparative Analysis. Journal of Medical Internet Research 2026;28:e90692 View
  5. Balaban U, Erbay B, Aktan M, Demirkan K. Performance of large language models on the Turkish Pharmacy Specialty Examination: a comparative analysis of accuracy, confidence, and readability. Scientific Reports 2026;16(1) View
  6. Ahmed M, Mansoor M, Mahmood H, Ebrahim R. Artificial Professionalism: An Evaluation of Six Large Language Models on the UK Multi-Specialty Recruitment Assessment Professional Dilemmas Paper. Cureus 2026 View
  7. Kastamoni Başkan M, Çeçen S, Kastamoni Y. Large Language Models and Applied Surgical Anatomy: Evaluation of Anatomical Reasoning in Expert‐Derived Plastic Surgery Scenarios. Clinical Anatomy 2026 View
  8. Bashah A, Huixin Q, Zaawari H, Al-Waqeerah A, Ghaleb E, Salem A, Wahan N, Chen G. Evaluating Internet-Based AI Chatbots as Unregulated Digital Health Resources in Dental Emergency Management: Comparative Multilingual Study. JMIR Medical Informatics 2026;14:e96731 View

Conference Proceedings

  1. Maheswara I, Yudistira F, Prasetyo A, Majiid M. 2026 International Conference on Information Management and Technology (ICIMTech). Analysis of Generalist and Domain-Specific Large Language Models for Medical Assessment View