Search Articles

View query in Help articles search

Search Results (1 to 10 of 28 Results)

Download search results: CSV END BibTex RIS


Performance of Plug-In Augmented ChatGPT and Its Ability to Quantify Uncertainty: Simulation Study on the German Medical Board Examination

Performance of Plug-In Augmented ChatGPT and Its Ability to Quantify Uncertainty: Simulation Study on the German Medical Board Examination

A medical board examination exemplifies these domains well, as it determines the qualification of medical students to obtain their license to practice medicine. Our primary outcome is the model’s ability to achieve the minimum required score for passing the 2 written parts of the German medical licensing examination.

Julian Madrid, Philipp Diehl, Mischa Selig, Bernd Rolauffs, Felix Patricius Hans, Hans-Jörg Busch, Tobias Scheef, Leo Benning

JMIR Med Educ 2025;11:e58375

Evaluation of ChatGPT Performance on Emergency Medicine Board Examination Questions: Observational Study

Evaluation of ChatGPT Performance on Emergency Medicine Board Examination Questions: Observational Study

Building upon this background, our study seeks to determine whether a targeted enhancement of Chat GPT-4 can increase the accuracy of the model in answering board examination questions, particularly for the American Board of Emergency Medicine (ABEM) Examinations. Chat GPT provides relatively accurate responses to questions in examinations such as the USMLE (United States Medical Licensing Examination) [13,14] and the ABFM (American Board of Family Medicine) examination [5].

Mila Pastrak, Sten Kajitani, Anthony James Goodings, Austin Drewek, Andrew LaFree, Adrian Murphy

JMIR AI 2025;4:e67696

Performance of Artificial Intelligence Chatbots on Ultrasound Examinations: Cross-Sectional Comparative Analysis

Performance of Artificial Intelligence Chatbots on Ultrasound Examinations: Cross-Sectional Comparative Analysis

Researchers have performed many evaluations and studies on chatbots to answer medical questions, including ophthalmology, pediatric, urology, dentistry, and other professional directions, involving myopia, cirrhosis, hypertension, obesity, and other diseases and medical examination questions [11,12]. With the rapid development of ultrasound medicine, the demand for ultrasound examination is increasing, and the teaching and popularization of ultrasound is limited.

Yong Zhang, Xiao Lu, Yan Luo, Ying Zhu, Wenwu Ling

JMIR Med Inform 2025;13:e63924

Impact of Ophthalmic Knowledge Assessment Program Scores and Surgical Volume on Subspecialty Fellowship Application in Ophthalmology Residency: Retrospective Cohort Study

Impact of Ophthalmic Knowledge Assessment Program Scores and Surgical Volume on Subspecialty Fellowship Application in Ophthalmology Residency: Retrospective Cohort Study

The Ophthalmic Knowledge Assessment Program (OKAP) is a multiple-choice nationwide examination used to assess the ophthalmic knowledge of ophthalmology residents compared with their peers at the same training stage (postgraduate years [PGY] 2, 3, and 4). OKAP exams are taken electronically in a supervised environment in March each year.

Amanda Kay Hertel, Radwan S Ajlan

JMIR Med Educ 2024;10:e60940

Assessment of ChatGPT-4 in Family Medicine Board Examinations Using Advanced AI Learning and Analytical Methods: Observational Study

Assessment of ChatGPT-4 in Family Medicine Board Examinations Using Advanced AI Learning and Analytical Methods: Observational Study

Family physicians in the United States are required to complete the American Board of Family Medicine (ABFM) Certification Examination following residency and every 10 years after to maintain board-certified status. This examination consists of 300 questions with a scaled scoring system ranging from 200 to 800; this corresponds to percent correct scores of 57.7%-61.0% [1].

Anthony James Goodings, Sten Kajitani, Allison Chhor, Ahmad Albakri, Mila Pastrak, Megha Kodancha, Rowan Ives, Yoo Bin Lee, Kari Kajitani

JMIR Med Educ 2024;10:e56128

Clinician-Prioritized Measures to Use in a Remote Concussion Assessment: Delphi Study

Clinician-Prioritized Measures to Use in a Remote Concussion Assessment: Delphi Study

In response to this shift, remote examination resources targeting family medicine physicians have been developed to support the diagnosis and acute evaluation of concussion through remote assessment [4]. These resources outline approaches that can be transferred from the typical in-person concussion examination to a remote context.

Keely Barnes, Heidi Sveistrup, Mark Bayley, Mary Egan, Martin Bilodeau, Michel Rathbone, Monica Taljaard, Shawn Marshall

JMIR Form Res 2024;8:e47246

Influence of Model Evolution and System Roles on ChatGPT’s Performance in Chinese Medical Licensing Exams: Comparative Study

Influence of Model Evolution and System Roles on ChatGPT’s Performance in Chinese Medical Licensing Exams: Comparative Study

Its performance in medicine was first tested at or near the passing threshold of the United States Medical Licensing Examination (USMLE) [1,2]. While Chat GPT’s accuracy varies across languages [3], it has been tested on a series of medical exams like the Japanese National Medical Licensing Examination in languages including English [4], Chinese [5], Dutch [6], Japanese [7], and Korean [8].

Shuai Ming, Qingge Guo, Wenjun Cheng, Bo Lei

JMIR Med Educ 2024;10:e52784

Reliability and Sensitivity of a Virtual Assessment Developed for Workplace Concussions: Protocol for a Method-Comparison Study

Reliability and Sensitivity of a Virtual Assessment Developed for Workplace Concussions: Protocol for a Method-Comparison Study

In this study, we are assessing the consistency of physical examination findings; people with other forms of acquired brain injury such as severe traumatic brain injury more frequently have signs of central nervous system deficits, whereas these assessments are often normal during a postconcussion examination [20,21]. This inclusion is thus intended to ensure recruitment of participants with a broad range of identifiable deficits on all components of the assessment.

Keely Barnes, Heidi Sveistrup, Mark Bayley, Michel Rathbone, Monica Taljaard, Mary Egan, Martin Bilodeau, Motahareh Karimijashni, Shawn Marshall

JMIR Res Protoc 2024;13:e57663

Appraisal of ChatGPT’s Aptitude for Medical Education: Comparative Analysis With Third-Year Medical Students in a Pulmonology Examination

Appraisal of ChatGPT’s Aptitude for Medical Education: Comparative Analysis With Third-Year Medical Students in a Pulmonology Examination

These students had previously taken the pulmonology examination in January 2020. The second group consists of Chat GPT-3.5, a freely available version of Chat GPT, which undertook the same pneumology examination in June 2023. The pneumology examination of FMT of 2020 is a 90-minute test comprising 50 questions, written in French. These questions underwent validation within the pneumology section of FMT to cover a diverse range of knowledge levels, including both fundamental and advanced concepts.

Hela Cherif, Chirine Moussa, Abdel Mouhaymen Missaoui, Issam Salouage, Salma Mokaddem, Besma Dhahri

JMIR Med Educ 2024;10:e52818

The Utility of Wearable Cameras in Developing Examination Questions and Answers on Physical Examinations: Preliminary Study

The Utility of Wearable Cameras in Developing Examination Questions and Answers on Physical Examinations: Preliminary Study

This study aimed to examine the utility of wearable cameras in creating examination questions and answers. We developed a single examination question focusing on physical examination skills for resident physicians. In October 2021, authors YN and TS created a simulated outpatient case of appendicitis: a middle-aged man with abdominal pain and localized peritoneal irritation in the right lower quadrant. A volunteer physician played the role of the simulated patient.

Sho Fukui, Taro Shimizu, Yuji Nishizaki, Kiyoshi Shikino, Yu Yamamoto, Hiroyuki Kobayashi, Yasuharu Tokuda

JMIR Med Educ 2024;10:e53193