This paper is in the following e-collection/theme issue:

Formative Evaluation of Digital Health Interventions (2491) Chatbots and Conversational Agents (543) mHealth for Screening (221) Diagnostic Tools in Mental Health (248)

Published on in Vol 3, No 4 (2019): Oct-Dec

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/13863, first published .
Accuracy of a Chatbot (Ada) in the Diagnosis of Mental Disorders: Comparative Case Study With Lay and Expert Users

Accuracy of a Chatbot (Ada) in the Diagnosis of Mental Disorders: Comparative Case Study With Lay and Expert Users

Accuracy of a Chatbot (Ada) in the Diagnosis of Mental Disorders: Comparative Case Study With Lay and Expert Users

Authors of this article:

Stefanie Maria Jungmann1 Author Orcid Image ;   Timo Klan1 Author Orcid Image ;   Sebastian Kuhn2 Author Orcid Image ;   Florian Jungmann2 Author Orcid Image
Article Authors Cited by (64) Tweetations (17) Metrics

Journals

  1. Randerath W, Dreher M, Gompelmann D, Held M, Koczulla R, Köhnlein T, Rohde G, Wälscher J, Watz H, Steinkamp G. Expertentreffen COPD: Technologische Innovationen in der Pneumologie – Facetten aus Diagnostik und Therapie. Pneumologie 2020;74(09):585 View
  2. Tjardes T, Heller R, Pförringer D, Lohmann R, Back D. Künstliche Intelligenz in der Orthopädie und Unfallchirurgie. Der Chirurg 2020;91(3):201 View
  3. Trentzsch H, Osterhoff G, Heller R, Nienaber U, Lazarovici M. Herausforderungen der Digitalisierung in der Traumaversorgung. Der Unfallchirurg 2020;123(11):843 View
  4. Mehl A, Bergey F, Cawley C, Gilsdorf A. Syndromic Surveillance Insights from a Symptom Assessment App Before and During COVID-19 Measures in Germany and the United Kingdom: Results From Repeated Cross-Sectional Analyses. JMIR mHealth and uHealth 2020;8(10):e21364 View
  5. Gilbert S, Mehl A, Baluch A, Cawley C, Challiner J, Fraser H, Millen E, Montazeri M, Multmeier J, Pick F, Richter C, Türk E, Upadhyay S, Virani V, Vona N, Wicks P, Novorol C. How accurate are digital symptom assessment apps for suggesting conditions and urgency advice? A clinical vignettes comparison to GPs. BMJ Open 2020;10(12):e040269 View
  6. Faqar-Uz-Zaman S, Filmann N, Mahkovic D, von Wagner M, Detemble C, Kippke U, Marschall U, Anantharajah L, Baumartz P, Sobotta P, Bechstein W, Schnitzbauer A. Study protocol for a prospective, double-blinded, observational study investigating the diagnostic accuracy of an app-based diagnostic health care application in an emergency room setting: the eRadaR trial. BMJ Open 2021;11(1):e041396 View
  7. Ćirković A. Evaluation of Four Artificial Intelligence–Assisted Self-Diagnosis Apps on Three Diagnoses: Two-Year Follow-Up Study. Journal of Medical Internet Research 2020;22(12):e18097 View
  8. Chung K, Cho H, Park J. A Chatbot for Perinatal Women’s and Partners’ Obstetric and Mental Health Care: Development and Usability Evaluation Study. JMIR Medical Informatics 2021;9(3):e18607 View
  9. Rigamonti L, Estel K, Gehlen T, Wolfarth B, Lawrence J, Back D. Use of artificial intelligence in sports medicine: a report of 5 fictional cases. BMC Sports Science, Medicine and Rehabilitation 2021;13(1) View
  10. Pförringer D, Matusiewicz D, Tsitsilonis S, Gehlen T, Back D. Ökonomische Aspekte der Digitalisierung in Orthopädie und Unfallchirurgie. Der Unfallchirurg 2020;123(11):856 View
  11. Vaidyam A, Linggonegoro D, Torous J. Changes to the Psychiatric Chatbot Landscape: A Systematic Review of Conversational Agents in Serious Mental Illness: Changements du paysage psychiatrique des chatbots: une revue systématique des agents conversationnels dans la maladie mentale sérieuse. The Canadian Journal of Psychiatry 2021;66(4):339 View
  12. Fan X, Chao D, Zhang Z, Wang D, Li X, Tian F. Utilization of Self-Diagnosis Health Chatbots in Real-World Settings: Case Study. Journal of Medical Internet Research 2021;23(1):e19928 View
  13. Alam L, Mueller S. Examining the effect of explanation on satisfaction and trust in AI diagnostic systems. BMC Medical Informatics and Decision Making 2021;21(1) View
  14. Benoit J, Hartling L, Chan M, Scott S. Characteristics of Acute Childhood Illness Apps for Parents: Environmental Scan. Journal of Medical Internet Research 2021;23(10):e29441 View
  15. van Bussel M, Odekerken–Schröder G, Ou C, Swart R, Jacobs M. Analyzing the determinants to accept a virtual assistant and use cases among cancer patients: a mixed methods study. BMC Health Services Research 2022;22(1) View
  16. Albrink K, Joos C, Schröder D, Müller F, Hummers E, Noack E. Obtaining patients’ medical history using a digital device prior to consultation in primary care: study protocol for a usability and validity study. BMC Medical Informatics and Decision Making 2022;22(1) View
  17. Ilicki J, Kakulapati V. Challenges in evaluating the accuracy of AI-containing digital triage systems: A systematic review. PLOS ONE 2022;17(12):e0279636 View
  18. Painter A, Hayhoe B, Riboli-Sasco E, El-Osta A. Online Symptom Checkers: Recommendations for a Vignette-Based Clinical Evaluation Standard. Journal of Medical Internet Research 2022;24(10):e37408 View
  19. Hennemann S, Kuhn S, Witthöft M, Jungmann S. Diagnostic Performance of an App-Based Symptom Checker in Mental Disorders: Comparative Study in Psychotherapy Outpatients. JMIR Mental Health 2022;9(1):e32832 View
  20. Huq S, Maskeliūnas R, Damaševičius R. Dialogue agents for artificial intelligence-based conversational systems for cognitively disabled: a systematic review. Disability and Rehabilitation: Assistive Technology 2024;19(3):1059 View
  21. Faqar-Uz-Zaman S, Anantharajah L, Baumartz P, Sobotta P, Filmann N, Zmuc D, von Wagner M, Detemble C, Sliwinski S, Marschall U, Bechstein W, Schnitzbauer A. The Diagnostic Efficacy of an App-based Diagnostic Health Care Application in the Emergency Room: eRadaR-Trial. A prospective, Double-blinded, Observational Study. Annals of Surgery 2022;276(5):935 View
  22. Kopka M, Schmieding M, Rieger T, Roesler E, Balzer F, Feufel M. Determinants of Laypersons’ Trust in Medical Decision Aids: Randomized Controlled Trial. JMIR Human Factors 2022;9(2):e35219 View
  23. Knitza J, Tascilar K, Gruber E, Kaletta H, Hagen M, Liphardt A, Schenker H, Krusche M, Wacker J, Kleyer A, Simon D, Vuillerme N, Schett G, Hueber A. Accuracy and usability of a diagnostic decision support system in the diagnosis of three representative rheumatic diseases: a randomized controlled trial among medical students. Arthritis Research & Therapy 2021;23(1) View
  24. Koulouri T, Macredie R, Olakitan D. Chatbots to Support Young Adults’ Mental Health: An Exploratory Study of Acceptability. ACM Transactions on Interactive Intelligent Systems 2022;12(2):1 View
  25. Boucher E, Harake N, Ward H, Stoeckl S, Vargas J, Minkel J, Parks A, Zilca R. Artificially intelligent chatbots in digital mental health interventions: a review. Expert Review of Medical Devices 2021;18(sup1):37 View
  26. Milne-Ives M, Selby E, Inkster B, Lam C, Meinert E, Narasimhan P. Artificial intelligence and machine learning in mobile apps for mental health: A scoping review. PLOS Digital Health 2022;1(8):e0000079 View
  27. Schick A, Feine J, Morana S, Maedche A, Reininghaus U. Validity of Chatbot Use for Mental Health Assessment: Experimental Study. JMIR mHealth and uHealth 2022;10(10):e28082 View
  28. Schmieding M, Kopka M, Schmidt K, Schulz-Niethammer S, Balzer F, Feufel M. Triage Accuracy of Symptom Checker Apps: 5-Year Follow-up Evaluation. Journal of Medical Internet Research 2022;24(5):e31810 View
  29. May R, Denecke K. Security, privacy, and healthcare-related conversational agents: a scoping review. Informatics for Health and Social Care 2022;47(2):194 View
  30. Knevel R, Knitza J, Hensvold A, Circiumaru A, Bruce T, Evans S, Maarseveen T, Maurits M, Beaart-van de Voorde L, Simon D, Kleyer A, Johannesson M, Schett G, Huizinga T, Svanteson S, Lindfors A, Klareskog L, Catrina A. Rheumatic?—A Digital Diagnostic Decision Support Tool for Individuals Suspecting Rheumatic Diseases: A Multicenter Pilot Validation Study. Frontiers in Medicine 2022;9 View
  31. Eeles E, Worthy P, Teodorczuk A, Kaur P, Dissanayaka N. Pilot testing of a new electronic diagnostic support tool (AiD-DST) designed to identify the cause(s) of delirium. Delirium Communications 2022 View
  32. Denecke K, Abd-Alrazaq A, Househ M, Warren J. Evaluation Metrics for Health Chatbots: A Delphi Study. Methods of Information in Medicine 2021;60(05/06):171 View
  33. El-Osta A, Webber I, Alaa A, Bagkeris E, Mian S, Taghavi Azar Sharabiani M, Majeed A. What is the suitability of clinical vignettes in benchmarking the performance of online symptom checkers? An audit study. BMJ Open 2022;12(4):e053566 View
  34. Gräf M, Knitza J, Leipe J, Krusche M, Welcker M, Kuhn S, Mucke J, Hueber A, Hornig J, Klemm P, Kleinert S, Aries P, Vuillerme N, Simon D, Kleyer A, Schett G, Callhoff J. Comparison of physician and artificial intelligence-based symptom checker diagnostic accuracy. Rheumatology International 2022;42(12):2167 View
  35. Martinengo L, Lum E, Car J. Evaluation of chatbot-delivered interventions for self-management of depression: Content analysis. Journal of Affective Disorders 2022;319:598 View
  36. Achtyes E, Glenn T, Monteith S, Geddes J, Whybrow P, Martini J, Bauer M. Telepsychiatry in an Era of Digital Mental Health Startups. Current Psychiatry Reports 2023;25(6):263 View
  37. Jui S, Deo R, Barua P, Devi A, Soar J, Acharya U. Application of Entropy for Automated Detection of Neurological Disorders With Electroencephalogram Signals: A Review of the Last Decade (2012–2022). IEEE Access 2023;11:71905 View
  38. Shania M, Handayani P, Asih S. Designing High-Fidelity Mobile Health for Depression in Indonesian Adolescents Using Design Science Research: Mixed Method Approaches. JMIR Formative Research 2023;7:e48913 View
  39. Lang M, McKibbin K, Shabani M, Borry P, Gautrais V, Verbeke K, Zawati M. Crowdsourcing smartphone data for biomedical research: Ethical and legal questions. DIGITAL HEALTH 2023;9 View
  40. Maia E, Vieira P, Praça I. Empowering Preventive Care with GECA Chatbot. Healthcare 2023;11(18):2532 View
  41. Wong R, Ming L, Raja Ali R. The Intersection of ChatGPT, Clinical Medicine, and Medical Education. JMIR Medical Education 2023;9:e47274 View
  42. Denecke K. Potential and pitfalls of conversational agents in health care. Nature Reviews Disease Primers 2023;9(1) View
  43. Peven K, Wickham A, Wilks O, Kaplan Y, Marhol A, Ahmed S, Bamford R, Cunningham A, Prentice C, Meczner A, Fenech M, Gilbert S, Klepchukova A, Ponzo S, Zhaunova L. Assessment of a Digital Symptom Checker Tool's Accuracy in Suggesting Reproductive Health Conditions: Clinical Vignettes Study. JMIR mHealth and uHealth 2023;11:e46718 View
  44. Abilkaiyrkyzy A, Laamarti F, Hamdi M, Saddik A. Dialogue System for Early Mental Illness Detection: Toward a Digital Twin Solution. IEEE Access 2024;12:2007 View
  45. Codipilly D, Faghani S, Hagan C, Lewis J, Erickson B, Iyer P. The Evolving Role of Artificial Intelligence in Gastrointestinal Histopathology: An Update. Clinical Gastroenterology and Hepatology 2024;22(6):1170 View
  46. Hammoud M, Douglas S, Darmach M, Alawneh S, Sanyal S, Kanbour Y. Evaluating the Diagnostic Performance of Symptom Checkers: Clinical Vignette Study. JMIR AI 2024;3:e46875 View
  47. MacNeill A, MacNeill L, Yi S, Goudreau A, Luke A, Doucet S. Depiction of conversational agents as health professionals: a scoping review. JBI Evidence Synthesis 2024;22(5):831 View
  48. Boian R, Bucur A, Todea D, Luca A, Rebedea T, Podina I. A conversational agent framework for mental health screening: design, implementation, and usability. Behaviour & Information Technology 2024:1 View
  49. Meczner A, Cohen N, Qureshi A, Reza M, Sutaria S, Blount E, Bagyura Z, Malak T. Controlling Inputter Variability in Vignette Studies Assessing Web-Based Symptom Checkers: Evaluation of Current Practice and Recommendations for Isolated Accuracy Metrics. JMIR Formative Research 2024;8:e49907 View
  50. Knitza J, Tascilar K, Fuchs F, Mohn J, Kuhn S, Bohr D, Muehlensiepen F, Bergmann C, Labinsky H, Morf H, Araujo E, Englbrecht M, Vorbrüggen W, von der Decken C, Kleinert S, Ramming A, Distler J, Bartz-Bazzanella P, Vuillerme N, Schett G, Welcker M, Hueber A. Diagnostic Accuracy of a Mobile AI-Based Symptom Checker and a Web-Based Self-Referral Tool in Rheumatology: Multicenter Randomized Controlled Trial. Journal of Medical Internet Research 2024;26:e55542 View
  51. Hindelang M, Sitaru S, Zink A. Transforming Health Care Through Chatbots for Medical History-Taking and Future Directions: Comprehensive Systematic Review. JMIR Medical Informatics 2024;12:e56628 View
  52. Zeng D, Chen G, Wang G, Zhou H, Guo C. Exploring GPT‐4.0's efficiency in handling paediatric appendicitis questions. Surgical Practice 2024 View
  53. Kleine A, Kokje E, Hummelsberger P, Lermer E, Schaffernak I, Gaube S. AI-enabled clinical decision support tools for mental healthcare: A product review. Artificial Intelligence in Medicine 2025;160:103052 View

Books/Policy Documents

  1. Díaz Carrillo M, Ramírez Pírez M, Lemos Chang G. Applied Informatics. View
  2. Ciesla R. The Book of Chatbots. View
  3. Barua R. Approaches to Human-Centered AI in Healthcare. View
  4. Orji J, Chan G, Ndulue C, Orji R. Persuasive Technology. View