This paper is in the following e-collection/theme issue:

Viewpoint (46) Viewpoint and Opinions on Innovation in Medical Education (78) Generative Language Models Including ChatGPT (708) AI Language Models in Health Care (202) Artificial Intelligence (AI) in Medical Education (182) Applications of AI (287) Viewpoints and Perspectives in AI (16) New Methods and Approaches in Medical Education (374)

Published on in Vol 9 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/51319, first published .
Assessing the Current Limitations of Large Language Models in Advancing Health Care Education

Assessing the Current Limitations of Large Language Models in Advancing Health Care Education

Assessing the Current Limitations of Large Language Models in Advancing Health Care Education

Authors of this article:

JaeYong Kim1 Author Orcid Image ;   Bathri Narayan Vajravelu2 Author Orcid Image
Article Authors Cited by (15) Tweetations Metrics Author Video

Journals

  1. Saji J, Balagangatharan A, Bajaj S, Swarnkar V, Unni D, Dileep A. Analysis of Patient Education Guides Generated by ChatGPT and Gemini on Common Anti-diabetic Drugs: A Cross-Sectional Study. Cureus 2025 View
  2. Oh N, Kim J, Park S, An S, Lee E, Do H, Baik J, Gwon S, Rhu J, Choi G, Park S, Cho J, Lee H, Lee B, Jeong E, Lee J, Choi Y, Kwon J, Kim K, Kim S, Chun G. Large Language Model–Assisted Surgical Consent Forms in Non-English Language: Content Analysis and Readability Evaluation. Journal of Medical Internet Research 2025;27:e73222 View
  3. Córdova-Esparza D. AI-Powered Educational Agents: Opportunities, Innovations, and Ethical Challenges. Information 2025;16(6):469 View
  4. Masur L, Driller M, Suppiah H, Matzka M, Sperlich B, Düking P. Assessment of Recommendations Provided to Athletes Regarding Sleep Education by GPT-4o and Google Gemini: Comparative Evaluation Study. JMIR Formative Research 2025;9:e71358 View
  5. Belkhouribchia J, Pen J. Large language models in clinical nutrition: an overview of its applications, capabilities, limitations, and potential future prospects. Frontiers in Nutrition 2025;12 View
  6. Liu Y, Yu F, Zhang X, Tong X, Li K, Gu W, Yu B. Assessing the Role of Large Language Models Between ChatGPT and DeepSeek in Asthma Education for Bilingual Individuals: Comparative Study. JMIR Medical Informatics 2025;13:e65365 View
  7. Gertz R, Beste N, Dratsch T, Lennartz S, Bremm J, Iuga A, Bunck A, Laukamp K, Schönfeld M, Kottlors J. From dictation to diagnosis: enhancing radiology reporting with integrated speech recognition in multimodal large language models. European Radiology 2025 View
  8. Gerçek A, Çiftci N, Durmuş M, Sarman A, Taşcı Ö, Yıldız M. ChatGPT in Nursing: Applications, Advantages, and Challenges in Education, Research, and Clinical Practice. Annals of Biomedical Engineering 2025;53(11):3202 View
  9. Khosravi M, Izadi R, Aghamaleki Sarvestani M, Bouzarjomehri H, Ahmadi Marzaleh M, Ravangard R. Performance of artificial intelligence large language models (Copilot and Gemini) compared to human experts in healthcare policy making: A mixed-methods cross-sectional study. Health Informatics Journal 2025;31(3) View
  10. Handler R, Sharma S, Hernandez-Boussard T. The fragile intelligence of GPT-5 in medicine. Nature Medicine 2025 View
  11. Ohu F, Burrell D, Jones L. Public Health Risk Management, Policy, and Ethical Imperatives in the Use of AI Tools for Mental Health Therapy. Healthcare 2025;13(21):2721 View
  12. Roeschl T, Hoffmann M, Hashemi D, Rarreck F, Hinrichs N, Trippel T, Gröschel M, Unbehaun A, Klein C, Kempfert J, Dreger H, O'Brien B, Hindricks G, Balzer F, Falk V, Meyer A. Assessing the Limitations of Large Language Models in Clinical Practice Guideline–Concordant Treatment Decision-Making on Real-World Data: Retrospective Study. JMIRx Med 2025;6:e74899 View
  13. Saji J, Jabeen J, Antony J. Evaluating readability, reliability, and originality of artificial intelligence-generated patient education guides for common rheumatological conditions. Journal of Public Health 2025 View

Books/Policy Documents

  1. Hutson J. Art History in the Age of Artificial Intelligence. View

Conference Proceedings

  1. Shailya K, Rajpal S, Krishnan G, Ravindran B. Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency. LExT: Towards Evaluating Trustworthiness of Natural Language Explanations View