journal article·2024-09-15Open access

Automated MRI Video Analysis for Pediatric Neuro-Oncology: An Experimental Approach

Artur Fabijan, Agnieszka Zawadzka-Fabijan, Robert Fabijan, Krzysztof Zakrzewski, Emilia Nowosławska, Róża Kosińska, Bartosz Polis

Applied Sciences· Volume 14· Issue 18

Abstract

Over the past year, there has been a significant rise in interest in the application of open-source artificial intelligence models (OSAIM) in the field of medicine. An increasing number of studies focus on evaluating the capabilities of these models in image analysis, including magnetic resonance imaging (MRI). This study aimed to investigate whether two of the most popular open-source AI models, namely ChatGPT 4o and Gemini Pro, can analyze MRI video sequences with single-phase contrast in sagittal and frontal projections, depicting a posterior fossa tumor corresponding to a medulloblastoma in a child. The study utilized video files from single-phase contrast-enhanced head MRI in two planes (frontal and sagittal) of a child diagnosed with a posterior fossa tumor, type medulloblastoma, confirmed by histopathological examination. Each model was separately provided with the video file, first in the sagittal plane, analyzing three different sets of commands from the most general to the most specific. The same procedure was applied to the video file in the frontal plane. The Gemini Pro model did not conduct a detailed analysis of the pathological change but correctly identified the content of the video file, indicating it was a brain MRI, and suggested that a specialist in the field should perform the evaluation. Conversely, ChatGPT 4o conducted image analysis but failed to recognize that the content was MRI. The attempts to detect the lesion were random and varied depending on the plane. These models could not accurately identify the video content or indicate the area of the neoplastic change, even after applying detailed queries. The results suggest that despite their widespread use in various fields, these models require further improvements and specialized training to effectively support medical diagnostics.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Glioma Diagnosis and Treatment · Brain Tumor Detection and Classification · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Neurosurgery, Polish-Mother’s Memorial Hospital Research Institute, 93-338 Lodz, Poland

Department of Rehabilitation Medicine, Faculty of Health Sciences, Medical University of Lodz, 90-419 Lodz, Poland

Independent Researcher, Luton LU2 0GS, UK

References (32)

Show source-provided references
1. A Comparative Analysis of AI Models in Complex Medical Decision-Making Scenarios: Evaluating ChatGPT, Claude AI, Bard, and Perplexity
2. GPT-4 and medical image analysis: Strengths, weaknesses and future directions10.21037/jmai-23-94 ↗
3. Zong, H., Li, J., Wu, E., Wu, R., Lu, J., and Shen, B. (2024). Performance of ChatGPT on Chinese national medical licensing examinations: A five-year examination evaluation study for physicians, pharmacists and nurses. BMC Med. Educ., 24.10.1186/s12909-024-05125-7 ↗
4. Artificial intelligence: ChatGPT as a disruptive didactic strategy in dental education10.1002/jdd.13485 ↗
5. Artificial intelligence compared with human-derived patient educational materials on cirrhosis10.1097/HC9.0000000000000367 ↗
6. Google DeepMind’s gemini AI versus ChatGPT: A comparative analysis in ophthalmology10.1038/s41433-024-02958-w ↗
7. Synergizing ChatGPT and general AI for enhanced medical diagnostic processes in head and neck imaging10.1007/s00405-024-08511-5 ↗
8. Maaz, M., Rasheed, H., Khan, S., and Khan, F.S. (2024). Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models. arXiv.10.18653/v1/2024.acl-long.679 ↗
9. Creating an AI-powered platform for neurosurgery alongside a usability examination: Progressing towards minimally invasive robotics
10. Enhancing Brain Tumor Classification in MRI: Leveraging Deep Convolutional Neural Networks for Improved Accuracy
11. Artificial intelligence solution to accelerate the acquisition of MRI images: Impact on the therapeutic care in oncology in radiology and radiotherapy departments10.1016/j.canrad.2023.11.004 ↗
12. Automated Brain Abnormality Detection using a Self-Supervised Text-Vision Framework
13. Chen, H., Xu, Q., Zhang, L., Kiraly, A.P., and Novak, C.L. (2007). Automated definition of mid-sagittal planes for MRI brain scans. Medical Imaging 2007: Image Processing, SPIE.10.1117/12.709942 ↗
14. Chat-GPT on brain tumors: An examination of Artificial Intelligence/Machine Learning’s ability to provide diagnoses and treatment plans for example neuro-oncology cases10.1016/j.clineuro.2024.108238 ↗
15. Prevalence of Pediatric brain tumor in children from a tertiary neurosurgical center, during a period from 2010 to 2018 in Baghdad, Iraq10.36295/ASRO.2021.24436 ↗
16. Salih, M.A. (2020). Pediatric Brain Tumors. Clinical Child Neurology, Springer.10.1007/978-3-319-43153-6 ↗
17. Jaju, A., Yeom, K.W., and Ryan, M.E. (2022). MR Imaging of Pediatric Brain Tumors. Diagnostics, 12.10.3390/diagnostics12040961 ↗
18. ChatGPT-4: A Breakthrough in Ultrasound Image Analysis10.1093/radadv/umae006 ↗
19. Lee, K.-H., and Lee, R.-W. (2024). ChatGPT’s Accuracy on Magnetic Resonance Imaging Basics: Characteristics and Limitations Depending on the Question Type. Diagnostics, 14.10.3390/diagnostics14020171 ↗
20. Empowering Radiology: The Transformative Role of ChatGPT10.1016/j.crad.2023.08.006 ↗
21. Rawas, S., Tafran, C., and AlSaeed, D. (2024). ChatGPT-powered Deep Learning: Elevating Brain Tumor Detection in MRI Scans. Appl. Comput. Inform., 1–13.10.1108/ACI-12-2023-0167 ↗
22. Yan, Z., Liu, J., Shuang, L., Xu, D., Yang, Y., Wang, H., Mao, J., Tseng, H., Chang, T., and Chen, Y. (2024). Large Language Models (LLMs) vs. Specialist Doctors: A Comparative Study on Health Information in specific medical domains. J. Med. Internet Res., in preprint.10.2196/preprints.62857 ↗
23. Wang, S. (2024). Beyond ChatGPT: It Is Time to Focus More on Specialized Medical LLMs. J. Endourol., 1–9.10.1089/end.2024.0374 ↗
24. Miyazaki, Y., Hata, M., Omori, H., Hirashima, A., Nakagawa, Y., Etō, M., Takahashi, S., and Ikeda, M. (2024). Performance and Errors of ChatGPT-4o on the Japanese Medical Licensing Examination: Solving All Questions Including Images with Over 90% Accuracy. JMIR Med. Educ., in preprint.10.2196/preprints.63129 ↗
25. Rough, K., Feng, H., Milligan, P.B., Tombini, F., Kwon, T., El Abidine, K.Z., Mack, C., and Hughes, B. (2024). How well it works: Benchmarking performance of GPT models on medical natural language processing tasks. medRxiv.10.1101/2024.06.10.24308699 ↗
26. Sharma, P., Jyotiyana, M., and Senthil Kumar, A.V. (2024). Algorithmic Issues, Challenges, and Theoretical Concerns of ChatGPT. Applications, Challenges, and the Future of ChatGPT, IGI Global. Chapter 3.10.4018/979-8-3693-6824-4 ↗
27. Evaluating ChatGPT: Strengths and Limitations in NLP Problem Solving10.54097/z15ne349 ↗
28. Schreiber, G., and Ohly, L. (2024). Herausforderungen in der Forschung: Mangelnde Reproduzierbarkeit und Erklärbarkeit. KI:Text: Diskurse Über KI-Textgeneratoren, De Gruyter.10.1515/9783111351490 ↗
29. Diagnostic Accuracy of ChatGPT for Textbook Descriptions of Epidermal Tumors: An Exploratory Study10.1097/DAD.0000000000002767 ↗
30. Pos0749 Respective Performances of ChatGPT and Google for the Diagnosis of Rare Diseases in Rheumatology
31. ChatGPT, MD: A Pilot Study Utilizing Large Language Models to Write Medical Abstracts10.1093/bjs/znae122.039 ↗
32. Li, K.C., Bu, Z.J., Shahjalal, M., He, B.X., Zhuang, Z.F., Li, C., Liu, J.P., Wang, B., and Liu, Z.L. (2024). Performance of ChatGPT on Chinese Master’s Degree Entrance Examination in Clinical Medicine. PLoS ONE, 19.10.1371/journal.pone.0301702 ↗