Accessibility settings

This paper is in the following e-collection/theme issue:

Development and Evaluation of Research Methods, Instruments and Tools (1364) Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (3278) Research Instruments, Questionnaires, and Tools (1216) Chatbots and Conversational Agents (1201) Artificial Intelligence (4887) Generative Language Models Including ChatGPT (1574) Theme Issue 2025: AI-Powered Therapy Bots and Virtual Companions in Digital Mental Health (89)

Published on in Vol 9 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/65605, first published .
Man lying on couch with eyes closed, hands outstretched towards laptop displaying chatbot logo.

Evaluating the Quality of Psychotherapy Conversational Agents: Framework Development and Cross-Sectional Study

Evaluating the Quality of Psychotherapy Conversational Agents: Framework Development and Cross-Sectional Study

Authors of this article:

Kunmi Sobowale1 Author Orcid Image ;   Daniel Kevin Humphrey2 Author Orcid Image
Article Authors Cited by (14) Tweetations Metrics

Journals

  1. Sobowale K, Humphrey D, Zhao S. Evaluating Generative AI Psychotherapy Chatbots Used by Youth: Cross-Sectional Study. JMIR Mental Health 2025;12:e79838 View
  2. Andrisano Ruggieri R, Ragosta A, Fornaciari T. The uncanny setting: therapeutic chatbots and the dissolution of the symbolic function in the clinical relationship. Psychodynamic Practice 2025:1 View
  3. Gu Y, Wang X. Developing a Service Quality Index System for AI Health Care Chatbots: Mixed Methods Study. Journal of Medical Internet Research 2026;28:e83051 View
  4. Schuchmann V, Trubitsyna O. Artificial intelligence as a means of psycho-emotional regulation under increased cryptocurrency market volatility. Ukrainian Journal of Applied Economics and Technology 2025;2025(4):302 View
  5. Freitas T, Marcondes F. Ecclesial Discernment in the Era of Generative Artificial Intelligence. Estudios Eclesiásticos. Revista de investigación e información teológica y canónica 2026;101(397):337 View
  6. Bernaerts S, Buelens F, De Witte N, Balaskas A, Colman T, Van Daele T. Exploring Real-World Use of AI Chatbots for Mental Health Support: Cross-Sectional Survey Study. JMIR Mental Health 2026;13:e104316 View
  7. Łabuz M, Szczęsny P, Mika-Łabuz K. Large language models (LLMs) as psychotherapists: an analysis based on psychodynamic psychotherapy theory. Ethics and Information Technology 2026;28(3) View
  8. Diel A, Torous J, Cuijpers P, Kleesiek J, Nensa F, Weber N, Faust F, Lalgi T, Mellis F, Teufel M, Bäuerle A. A scoping review on the mental health harms of LLM-based chatbots. npj Digital Medicine 2026;9(1) View
  9. Larrison C, Sinha G, Kursuncu U. Responsible AI in mental health services. Social Work in Mental Health 2026:1 View
  10. Keren L, Klein A, Bar-Shachar Y, Liakata M, Atzil-Slonim D. A comparative evaluation of LLM-generated and clinician-written psychotherapy session summaries. Psychotherapy Research 2026:1 View

Conference Proceedings

  1. Yadav S, Sam A, Jitto J, L J. 2026 9th International Conference on Computational Intelligence in Data Science (ICCIDS). Agentic AI for Therapy View
  2. Islam F, Zhao K, Knijnenburg B, Chen M, Leow A, Muthukanagaraj P, Zhan L, Shi C. 2025 IEEE International Conference on Data Mining Workshops (ICDMW). Pretraining a Generative AI Model on CBT Sessions to Emulate Human Therapist Strategies: A Study Using the APA Psyctherapy Database View
  3. Abdrabou Y, Abdelrahman Y, Bozkir E, Mazen Y, Alt F, Kasneci E. Proceedings of the 8th ACM Conference on Conversational User Interfaces. Beyond Benchmarks: A User-Centric Framework for Evaluating Large Language Models View
  4. Menard C, Thual L, Philip P, Pécune F. Proceedings of the 26th ACM International Conference on Intelligent Virtual Agents. French translation of the Artificial-Social-Agent questionnaire (ASAq) instrument for evaluating human-agent interactions View