TY  - JOUR
AU  - Burns, Christina
AU  - Bakaj, Angela
AU  - Berishaj, Amonda
AU  - Hristidis, Vagelis
AU  - Deak, Pamela
AU  - Equils, Ozlem
PY  - 2024
DA  - 2024/8/6
TI  - Use of Generative AI for Improving Health Literacy in Reproductive Health: Case Study
JO  - JMIR Form Res
SP  - e59434
VL  - 8
KW  - ChatGPT
KW  - chat-GPT
KW  - chatbots
KW  - chat-bot
KW  - chat-bots
KW  - artificial intelligence
KW  - AI
KW  - machine learning
KW  - ML
KW  - large language model
KW  - large language models
KW  - LLM
KW  - LLMs
KW  - natural language processing
KW  - NLP
KW  - deep learning
KW  - chatbot
KW  - Google Search
KW  - internet
KW  - communication
KW  - English proficiency
KW  - readability
KW  - health literacy
KW  - health information
KW  - health education
KW  - health related questions
KW  - health information seeking
KW  - health access
KW  - reproductive health
KW  - oral contraceptive
KW  - birth control
KW  - emergency contraceptive
KW  - comparison
KW  - clinical
KW  - patients
AB  - Background: Patients find technology tools to be more approachable for seeking sensitive health-related information, such as reproductive health information. The inventive conversational ability of artificial intelligence (AI) chatbots, such as ChatGPT (OpenAI Inc), offers a potential means for patients to effectively locate answers to their health-related questions digitally. Objective: A pilot study was conducted to compare the novel ChatGPT with the existing Google Search technology for their ability to offer accurate, effective, and current information regarding proceeding action after missing a dose of oral contraceptive pill. Methods: A sequence of 11 questions, mimicking a patient inquiring about the action to take after missing a dose of an oral contraceptive pill, were input into ChatGPT as a cascade, given the conversational ability of ChatGPT. The questions were input into 4 different ChatGPT accounts, with the account holders being of various demographics, to evaluate potential differences and biases in the responses given to different account holders. The leading question, “what should I do if I missed a day of my oral contraception birth control?” alone was then input into Google Search, given its nonconversational nature. The results from the ChatGPT questions and the Google Search results for the leading question were evaluated on their readability, accuracy, and effective delivery of information. Results: The ChatGPT results were determined to be at an overall higher-grade reading level, with a longer reading duration, less accurate, less current, and with a less effective delivery of information. In contrast, the Google Search resulting answer box and snippets were at a lower-grade reading level, shorter reading duration, more current, able to reference the origin of the information (transparent), and provided the information in various formats in addition to text. Conclusions: ChatGPT has room for improvement in accuracy, transparency, recency, and reliability before it can equitably be implemented into health care information delivery and provide the potential benefits it poses. However, AI may be used as a tool for providers to educate their patients in preferred, creative, and efficient ways, such as using AI to generate accessible short educational videos from health care provider-vetted information. Larger studies representing a diverse group of users are needed. 
SN  - 2561-326X
UR  - https://formative.jmir.org/2024/1/e59434
UR  - https://doi.org/10.2196/59434
UR  - http://www.ncbi.nlm.nih.gov/pubmed/38986153
DO  - 10.2196/59434
ID  - info:doi/10.2196/59434
ER  -