Performance and Hallucination Analysis of Large Language Models on European Anesthesiology Examinations: Cross-Sectional Comparative Study

Stefan Andrei   ^{1, 2} , MD, PhD ;   Thibault Giet   ¹ , BS ;   Alexis Belouard   ¹ , BS ;   Mihai Stefan   ^{3, 4} , MD ;   Mihai Popescu   ^{3, 5} , MD, PhD ;   Sébastien Tanaka   ^{1, 6} , MD, PhD ;   Philippe Montravers   ^{1, 7} , MD, PhD ;   Aurélie Gouel   ^{1, 8} , MD, PhD

¹ Department of Anesthesiology and Intensive Care, CHU Bichat Claude Bernard, Assistance Publique, Hôpitaux de Paris, Paris, Île-de-France, France

² Group of Data Modeling, Computational Biology, and Predictive Medicine, Applied Mathematics, Institut de Biologie de l'École Normale Supérieure, Paris, Île-de-France, France

³ Discipline of Anaesthesiology and Intensive Care, Carol Davila University of Medicine and Pharmacy, Bucharest, București, Romania

⁴ 2nd of Department of Anaesthesiology and Intensive Care, Institutul de Urgenţă pentru Boli Cardiovasculare "Prof.Dr. C.C. Iliescu", Bucharest, București, Romania

⁵ Department of Anaesthesiology and Intensive Care, Bucharest Emergency University Hospital, Bucharest, București, Romania

⁶ Diabète athérothrombose Thérapies Réunion Océan Indien (DéTROI), INSERM UMR 1188, University of Reunion Island, Saint-Pierre de La Réunion, Réunion, Réunion

⁷ Physiopathology and Epidemiology of Respiratory Diseases, INSERM UMR1152, Université Paris Cité, Paris, Île-de-France, France

⁸ Antibodies in Therapy and Pathology, Institut Pasteur, INSERM UMR1222, Université Paris Cité, Paris, Île-de-France, France