%0 Journal Article
%@ 2561-326X
%I JMIR Publications
%V 7
%N 
%P e49459
%T Strengths and Weaknesses of ChatGPT Models for Scientific Writing About Medical Vitamin B12: Mixed Methods Study
%A Abuyaman,Omar
%+ Department of Medical Laboratory Sciences, Faculty of Applied Medical Sciences, The Hashemite University, FAMS Bldg, 2nd fl, Zarqa, 13133, Jordan, 962 781074280, o.abuyaman@gmail.com
%K AI
%K ChatGPT
%K GPT-4
%K GPT-3.5
%K vitamin B12
%K artificial intelligence
%K language editing
%K wide range information
%K AI solutions
%K scientific content
%D 2023
%7 10.11.2023
%9 Original Paper
%J JMIR Form Res
%G English
%X Background: ChatGPT is a large language model developed by OpenAI designed to generate human-like responses to prompts. Objective: This study aims to evaluate the ability of GPT-4 to generate scientific content and assist in scientific writing using medical vitamin B12 as the topic. Furthermore, the study will compare the performance of GPT-4 to its predecessor, GPT-3.5. Methods: The study examined responses from GPT-4 and GPT-3.5 to vitamin B12–related prompts, focusing on their quality and characteristics and comparing them to established scientific literature. Results: The results indicated that GPT-4 can potentially streamline scientific writing through its ability to edit language and write abstracts, keywords, and abbreviation lists. However, significant limitations of ChatGPT were revealed, including its inability to identify and address bias, inability to include recent information, lack of transparency, and inclusion of inaccurate information. Additionally, it cannot check for plagiarism or provide proper references. The accuracy of GPT-4’s answers was found to be superior to GPT-3.5. Conclusions: ChatGPT can be considered a helpful assistant in the writing process but not a replacement for a scientist’s expertise. Researchers must remain aware of its limitations and use it appropriately. The improvements in consecutive ChatGPT versions suggest the possibility of overcoming some present limitations in the near future. 
%M 37948100
%R 10.2196/49459
%U https://formative.jmir.org/2023/1/e49459
%U https://doi.org/10.2196/49459
%U http://www.ncbi.nlm.nih.gov/pubmed/37948100