This paper is in the following e-collection/theme issue:

Formative Evaluation of Digital Health Interventions (3229) Generative Language Models Including ChatGPT (708) Development and Evaluation of Research Methods, Instruments and Tools (744) Simulation (164) Artificial Intelligence (AI) in Medical Education (182)

Published on in Vol 9 (2025)

This is a member publication of University of California, Irvine, Emergency Medicine, Orange, California

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/66478, first published .
Novel Evaluation Metric and Quantified Performance of ChatGPT-4 Patient Management Simulations for Early Clinical Education: Experimental Study

Novel Evaluation Metric and Quantified Performance of ChatGPT-4 Patient Management Simulations for Early Clinical Education: Experimental Study

Novel Evaluation Metric and Quantified Performance of ChatGPT-4 Patient Management Simulations for Early Clinical Education: Experimental Study

Authors of this article:

Riley Scherr1 Author Orcid Image ;   Aidin Spina1 Author Orcid Image ;   Allen Dao2 Author Orcid Image ;   Saman Andalib1 Author Orcid Image ;   Faris F Halaseh1 Author Orcid Image ;   Sarah Blair3 Author Orcid Image ;   Warren Wiechmann4 Author Orcid Image ;   Ronald Rivera4 Author Orcid Image
Article Authors Cited by (4) Tweetations Metrics

Journals

  1. Cheng Y, Zhu L. A review of ChatGPT in medical education: exploring advantages and limitations. International Journal of Surgery 2025;111(7):4586 View
  2. Wagner W, Gaskell G, Paraschou E, Lyu S, Michali M, Vakali A. Limits of ChatGPT's conversational pragmatics in a Turing test on ethics, commonsense, and cultural sensitivity. Computers in Human Behavior: Artificial Humans 2025;5:100191 View
  3. Ebihara H, Kasai H, Shimizu I, Shikino K, Tajima H, Kimura Y, Ito S. Development of a Clinical Clerkship Mentor Using Generative AI and Evaluation of Its Effectiveness in a Medical Student Trial Compared to Student Mentors: 2-Part Comparative Study. JMIR Medical Education 2025;11:e76702 View
  4. van Velzen M, van der Willigen R, de Beer V, de Graaf-Waar H, Janssen E, van Leeuwen S, van der Willigen M, van der Willigen M, Renardus G, El Maaroufi R, Satimin S, Hartog L, Hulsen T, van Meeteren N, Scheper M. Privacy-, linguistic-, and information-preserving synthesis of clinical documentation through generative agents. Frontiers in Artificial Intelligence 2025;8 View