This paper is in the following e-collection/theme issue:

Formative Evaluation of Digital Health Interventions (3229) Ontologies, Classifications, and Coding (324) Artificial Intelligence (2129) Natural Language Processing (917) Clinical Information and Decision Making (1915) Clinical Informatics (1325) Knowledge Translation and Implementation Science (513) Machine Learning (2076)

Published on in Vol 8 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/32690, first published .
Vision-Language Model for Generating Textual Descriptions From Clinical Images: Model Development and Validation Study

Vision-Language Model for Generating Textual Descriptions From Clinical Images: Model Development and Validation Study

Vision-Language Model for Generating Textual Descriptions From Clinical Images: Model Development and Validation Study

Authors of this article:

Jia Ji1 Author Orcid Image ;   Yongshuai Hou2 Author Orcid Image ;   Xinyu Chen3 Author Orcid Image ;   Youcheng Pan2 Author Orcid Image ;   Yang Xiang2 Author Orcid Image
Article Authors Cited by (20) Tweetations (2) Metrics

Journals

  1. Sarangi P, Datta S, Mondal H. Comment on: ChatGPT: Chasing the Storm in Radiology Training and Education. Indian Journal of Radiology and Imaging 2024;34(04):792 View
  2. Azhar K, Lee B, Byon S, Cho K, Song S. AI-Powered Synthesis of Structured Multimodal Breast Ultrasound Reports Integrating Radiologist Annotations and Deep Learning Analysis. Bioengineering 2024;11(9):890 View
  3. Wang P, Lu W, Lu C, Zhou R, Li M, Qin L. Large Language Model for Medical Images: A Survey of Taxonomy, Systematic Review, and Future Trends. Big Data Mining and Analytics 2025;8(2):496 View
  4. Li X, Li L, Jiang Y, Wang H, Qiao X, Feng T, Luo H, Zhao Y. Vision-Language Models in medical image analysis: From simple fusion to general large models. Information Fusion 2025;118:102995 View
  5. Kottlors J, Hahnfeldt R, Görtz L, Iuga A, Fervers P, Bremm J, Zopfs D, Laukamp K, Onur O, Lennartz S, Schönfeld M, Maintz D, Kabbasch C, Persigehl T, Schlamann M. Large Language Models–Supported Thrombectomy Decision-Making in Acute Ischemic Stroke Based on Radiology Reports: Feasibility Qualitative Study. Journal of Medical Internet Research 2025;27:e48328 View
  6. Yi Z, Xiao T, Albert M. A Survey on Multimodal Large Language Models in Radiology for Report Generation and Visual Question Answering. Information 2025;16(2):136 View
  7. Chen Y, Zhang C, Bai R, Sun T, Ding W, Wang R. A review of medical text analysis: Theory and practice. Information Fusion 2025;119:103024 View
  8. Sun Y, Wen X, Zhang Y, Jin L, Yang C, Zhang Q, Jiang M, Xu Z, Guo W, Su J, Jiang X. Visual-language foundation models in medical imaging: A systematic review and meta-analysis of diagnostic and analytical applications. Computer Methods and Programs in Biomedicine 2025;268:108870 View
  9. Urooj B, Fayaz M, Ali S, Dang L, Kim K. Large Language Models in Medical Image Analysis: A Systematic Survey and Future Directions. Bioengineering 2025;12(8):818 View
  10. Hosseini A, Ibrahim A, Serag A. M3: multimodal artificial intelligence for medical report generation and visual question answering from 3D abdominal CT scans. BJR|Artificial Intelligence 2025;2(1) View
  11. Cao Z, Keloth V, Xie Q, Qian L, Liu Y, Wang Y, Shi R, Zhou W, Yang G, Zhang J, Peng X, Zhen E, Weng R, Chen Q, Xu H. The Development Landscape of Large Language Models for Biomedical Applications. Annual Review of Biomedical Data Science 2025;8(1):251 View
  12. Wang C, Li M, He J, Wang Z, Darzi E, Chen Z, Ye J, Li T, Su Y, Ke J, Qu K, Li S, Yu Y, Liò P, Wang T, Wang Y, Shen Y. A survey for large language models in biomedicine. Artificial Intelligence in Medicine 2025;170:103268 View
  13. Ali M, Zafar A, Kim S, Kim K, Lee S. From task-specific to foundation models: A paradigm shift in medical vision-language analysis. Computer Science Review 2026;59:100831 View
  14. Abdikenov B, Zhaksylyk T, Imasheva A, Rakishev D. From Mammogram Analysis to Clinical Integration with Deep Learning in Breast Cancer Diagnosis. Informatics 2025;12(4):106 View
  15. Okayo O, Panwal N, Ihuarulam O, Nzunde M, Nyimwadang F, Oladosu T, Osunde. A. Transforming Medical Laboratory Science with Vision-Language Models: A Focus on Microscopy in Microbiology, Hematology, and Histopathology. Oncology, Nuclear Medicine and Transplantology 2025;1(2):onmt008 View
  16. Tejani A, Rauschecker A, Kohli M, Mongan J. AI for Radiology: A Primer Part I. From Idea to Algorithm. Radiology 2025;317(1) View

Books/Policy Documents

  1. La Quatra M, Cilia N, Conti V, Sorce S, Garraffa G, Salerno V. Pattern Recognition. ICPR 2024 International Workshops and Challenges. View
  2. Gaikwad P, Masal P, Kulkarni M, Turuk M. Smart Trends in Computing and Communications. View

Conference Proceedings

  1. Chiumento F, Liu M. 2024 IEEE International Conference on Big Data (BigData). Leveraging Multimodal Models for Enhanced Neuroimaging Diagnostics in Alzheimer’s Disease View
  2. Litvinova T, Molchanova V, Dekhnich O, Seredin P. 2025 38th Conference of Open Innovations Association (FRUCT). Describing Images: Linguistic Signatures of AI and Humans View