Natural Language Processing in Breast Imaging Reports: A Scoping Review with Implications for Low-Resource Clinical Languages
Source abstract
Abstract
Breast imaging reports are commonly recorded as unstructured free-text documents, which limits their secondary use for large-scale clinical analysis, structured information extraction, and clinical decision support. These challenges are particularly important in morphologically rich and low-resource clinical languages, where linguistic variability, inconsistent terminology, and limited annotated corpora may reduce the direct applicability of existing natural language processing (NLP) approaches. This study presents a scoping review of NLP research on breast imaging reports, conducted and reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR). Attention is given to BI-RADS (Breast Imaging Reporting and Data System)-related analytical tasks, methodological trends, dataset characteristics, evaluation practices, and implications for low-resource clinical NLP settings, including Turkish. A comprehensive literature search was conducted across Web of Science, Scopus, PubMed, IEEE Xplore, and Google Scholar in February 2026. To reduce the risk of missing recent studies using transformer- and large language model (LLM)-related terminology, a targeted supplementary search was also conducted. Following screening and eligibility assessment, 39 studies were included in the final synthesis. The findings show that the literature is concentrated mainly on BI-RADS classification/annotation and information extraction tasks. Task-wise, BI-RADS classification/annotation was the most frequent category, followed by information extraction. Methodologically, the reviewed literature shows a shift from rule-based and traditional machine learning approaches toward transformer- and LLM-based methods. LLM-based studies were frequently represented, particularly among recent studies and those identified through the targeted supplementary search; therefore, their observed prominence should be interpreted cautiously. Despite these advances, the literature remains linguistically imbalanced and methodologically heterogeneous. English was the most frequently represented report or dataset language, whereas Turkish breast imaging NLP studies remained limited. Major challenges identified across the reviewed studies include dataset heterogeneity, inconsistent annotation practices, variable evaluation metrics, limited external validation, and incomplete reporting of reproducibility-related details. This scoping review provides a structured synthesis of methodological trends, task categories, dataset characteristics, evaluation practices, and reproducibility-related limitations in breast imaging NLP. Overall, the findings highlight the need for better documented datasets, standardised evaluation practices, transparent reporting, clinically grounded validation, and stronger research efforts for low-resource clinical language settings.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Biomedical Text Mining and Ontologies · Topic Modeling · AI in cancer detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Programming, Trade and Industry Vocational School, KTO Karatay University, 42020 Konya, Turkey
Department of Computer Engineering, Faculty of Computer and Information Sciences, Konya Technical University, 42250 Konya, Turkey
Department of Radiology, Faculty of Medicine, Internal Medicine Sciences, Necmettin Erbakan University, 42090 Konya, Turkey
References (70)
Show source-provided references
1. Artificial intelligence in healthcare: Past, present and future10.1136/svn-2017-000101 ↗
2. Toward best practices in radiology reporting10.1148/radiol.2523081992 ↗
3. Natural language processing in radiology: A systematic review10.1148/radiol.16142770 ↗
4. Natural language processing to convert unstructured COVID-19 chest CT reports into structured reports10.1016/j.ejro.2023.100512 ↗
5. Casey, A., Davidson, E., Poon, M., Dong, H., Duma, D., Grivas, A., Grover, C., Suárez-Paniagua, V., Tobin, R., and Whiteley, W. (2021). A systematic review of natural language processing applied to radiology reports. BMC Med. Inform. Decis. Mak., 21.10.1186/s12911-021-01533-7 ↗
6. Clinical information extraction applications: A literature review10.1016/j.jbi.2017.11.011 ↗
7. Review of natural language processing in radiology10.1016/j.nic.2020.08.001 ↗
8. American College of Radiology (2013). ACR BI-RADS Atlas: Breast Imaging Reporting and Data System, American College of Radiology. [5th ed.].
9. Natural language processing to facilitate breast cancer research and management10.1111/tbj.13718 ↗
10. Saha, A., Burns, L., and Kulkarni, A.M. (2023). A scoping review of natural language processing of radiology reports in breast cancer. Front. Oncol., 13.10.3389/fonc.2023.1160167 ↗
11. Automatic Abstraction of Imaging Observations with Their Characteristics from Mammography Reports10.1136/amiajnl-2014-003009 ↗
12. Automatic Information Extraction from Unstructured Mammography Reports Using Distributed Semantics10.1016/j.jbi.2017.12.016 ↗
13. Automated Detection of Measurements and Their Descriptors in Radiology Reports Using a Hybrid Natural Language Processing Algorithm10.1007/s10278-019-00237-9 ↗
14. Post-Structuring Radiology Reports of Breast Cancer Patients for Clinical Quality Assurance10.1109/TCBB.2019.2914678 ↗
15. Automated Extraction of BI-RADS Final Assessment Categories from Radiology Reports with Natural Language Processing10.1007/s10278-013-9616-5 ↗
16. Automated annotation and classification of BI-RADS assessment from radiology reports10.1016/j.jbi.2017.04.011 ↗
17. Automatic Inference of BI-RADS Final Assessment Categories from Narrative Mammography Report Findings10.1016/j.jbi.2019.103137 ↗
18. Hussain, S., Naseem, U., Ali, M., Avendaño Avalos, D.B., Cardona-Huerta, S., Bosques Palomo, B.A., and Tamez-Peña, J.G. (2024). TECRR: A benchmark dataset of radiological reports for BI-RADS classification. BMC Med. Inform. Decis. Mak., 24.10.1186/s12911-024-02717-7 ↗
19. Efficient labeling of French mammogram reports with MammoBERT10.1038/s41598-024-76369-y ↗
20. Using BERT models for breast cancer diagnosis from Turkish radiology reports10.1007/s10579-023-09669-w ↗
21. Deep learning for natural language processing in radiology—Fundamentals and a systematic review10.1016/j.jacr.2019.12.026 ↗
22. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2–7). BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA.
23. BioBERT: A pre-trained biomedical language representation model for biomedical text mining10.1093/bioinformatics/btz682 ↗
24. Kuling, G., Curpen, B., and Martel, A.L. (2022). BI-RADS BERT and Using Section Segmentation to Understand Radiology Reports. J. Imaging, 8.10.3390/jimaging8050131 ↗
25. RadioLOGIC: A healthcare foundation model for radiology report understanding and generation from longitudinal clinical data10.1016/j.xcrm.2023.101131 ↗
26. A Scoping Review of Large Language Model Based Approaches for Information Extraction from Radiology Reports10.1038/s41746-024-01219-0 ↗
27. Diab, K.M., Deng, J., Wu, Y., Yesha, Y., Collado-Mesa, F., and Nguyen, P. (2023). Natural Language Processing for Breast Imaging: A Systematic Review. Diagnostics, 13.10.3390/diagnostics13081420 ↗
28. Ordu, S.K., and Yıldız, O. (2022, January 20–22). Türkçe radyoloji raporlarının doğal dil işlenmesi. Proceedings of the 6th International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT 2022), Ankara, Türkiye.10.1109/ISMSIT56059.2022.9932766 ↗
29. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation10.7326/M18-0850 ↗
30. Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., and Askell, A. (2020, January 6–12). Language Models Are Few-Shot Learners. Proceedings of the Advances in Neural Information Processing Systems 33 (NeurIPS 2020), Virtual. Available online: https://arxiv.org/abs/2005.14165.
31. Bommasani, R., Hudson, D.A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M.S., Bohg, J., Bosselut, A., and Brunskill, E. (2021). On the Opportunities and Risks of Foundation Models. arXiv.
32. Natural language processing in narrative breast radiology reporting in University Malaya Medical Centre10.1177/14604582231203763 ↗
33. Text Categorization with Support Vector Machines: Learning with Many Relevant Features
34. Machine Learning in Automated Text Categorization10.1145/505282.505283 ↗
35. Evaluation of an Automated Information Extraction Tool for Imaging Data Elements to Populate a Breast Cancer Screening Registry10.1007/s10278-014-9762-4 ↗
36. Using automatically extracted information from mammography reports for decision-support10.1016/j.jbi.2016.07.001 ↗
37. Possibilities and Limitations of Using Machine Text-Processing Tools in Russian Radiology Reports10.17816/DD101099 ↗
38. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient Estimation of Word Representations in Vector Space. arXiv.
39. Pennington, J., Socher, R., and Manning, C.D. (2014, January 25–29). GloVe: Global Vectors for Word Representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1162 ↗
40. Enriching Word Vectors with Subword Information10.1162/tacl_a_00051 ↗
41. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
42. Bidirectional Recurrent Neural Networks10.1109/78.650093 ↗
43. Kim, Y. (2014, January 25–29). Convolutional Neural Networks for Sentence Classification. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1181 ↗
44. Extraction of BI-RADS Findings from Breast Ultrasound Reports in Chinese Using Deep Learning Approaches10.1016/j.ijmedinf.2018.08.009 ↗
45. Comprehensive Word-Level Classification of Screening Mammography Reports Using a Neural Network Sequence Labeling Approach10.1007/s10278-018-0141-4 ↗
46. A Deep Learning-Based Decision Support Tool for Precision Risk Assessment of Breast Cancer10.1200/CCI.18.00121 ↗
47. Cabrera, E.R.S., Díaz, A.S., Menasalvas, E., Pena, J.G.T., and Robles, V. (2024, January 26–28). Named Entity Recognition in Mammography Radiology Reports Using a Multilingual Transfer Learning Approach. Proceedings of the 2024 IEEE 37th International Symposium on Computer-Based Medical Systems (CBMS), L’Aquila, Italy.
48. Moroz-Dubenco, C., and Andreica, A. (2026). Automated Classification of Romanian Mammography Reports. Innovative Perspectives on Computational Intelligence and Data Science, Springer.10.1007/978-3-032-12478-4_14 ↗
49. Alsentzer, E., Murphy, J.R., Boag, W., Weng, W.-H., Jin, D., Naumann, T., and McDermott, M. (2019, January 7). Publicly Available Clinical BERT Embeddings. Proceedings of the 2nd Clinical Natural Language Processing Workshop, Minneapolis, MN, USA.10.18653/v1/W19-1909 ↗
50. Automatic classification and prioritisation of actionable BI-RADS categories using natural language processing models10.1016/j.crad.2023.09.009 ↗
51. Interpreting BI-RADS-free breast MRI reports using a large language model: Automated BI-RADS classification from narrative reports using ChatGPT10.1016/j.acra.2025.08.026 ↗
52. Structured report generation for breast cancer imaging based on large language modeling: A comparative analysis of GPT-4 and DeepSeek10.1016/j.acra.2025.07.046 ↗
53. Akçalı, Z., Cubuk, H.S., Oguz, A., Kocak, M., Farzaliyeva, A., Guven, F., Ramazanoglu, M.N., Hasdemir, E., Altundag, O., and Agildere, A.M. (2025). Automated extraction of key entities from non-English mammography reports using named entity recognition with prompt engineering. Bioengineering, 12.10.3390/bioengineering12020168 ↗
54. Enhancing bidirectional encoder representations from transformers (BERT) with frame semantics to extract clinically relevant information from German mammography reports10.2196/68427 ↗
55. A comparative performance analysis of regular expressions and a large language model-based approach to extract the BI-RADS score from radiological reports10.1093/jamiaopen/ooaf128 ↗
56. Saito, T., and Rehmsmeier, M. (2015). The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets. PLoS ONE, 10.10.1371/journal.pone.0118432 ↗
57. Chicco, D., and Jurman, G. (2020). The Advantages of the Matthews Correlation Coefficient (MCC) over F1 Score and Accuracy in Binary Classification Evaluation. BMC Genom., 21.10.1186/s12864-019-6413-7 ↗
58. BioBERTurk: Exploring Turkish Biomedical Language Model Development Strategies in Low-Resource Setting10.1007/s41666-023-00140-7 ↗
59. Hybrid framework for automated generation of mammography radiology reports10.1016/j.csbj.2025.07.018 ↗
60. Implementing a resource-light and low-code large language model system for information extraction from mammography reports: A pilot study10.1007/s10278-025-01659-4 ↗
61. Bootstrapping BI-RADS Classification Using Large Language Models and Transformers in Breast Magnetic Resonance Imaging Reports10.1186/s42492-025-00189-8 ↗
62. BI-RADS-Compliant Structured Mammography Reporting Using Locally Deployed Large Language Models under Privacy Constraints10.1007/s00330-025-12147-2 ↗
63. Using a Large Language Model for Breast Imaging Reporting and Data System Classification and Malignancy Prediction to Enhance Breast Ultrasound Diagnosis: Retrospective Study10.2196/70924 ↗
64. BI-RADS Category Assignments by GPT-3.5, GPT-4, and Google Bard: A Multilanguage Study10.1148/radiol.232133 ↗
65. Comparative Evaluation of BI-RADS Classification, Clinical Management, and Diagnostic Performance in Breast Ultrasound Reports Using ChatGPT-4o and DeepSeek-V310.1053/j.sult.2025.10.002 ↗
66. Performance of ChatGPT-4o, Claude 3 Opus, and DeepSeek-R1 in BI-RADS Category 4 Classification and Malignancy Prediction from Mammography Reports: Retrospective Diagnostic Study10.2196/80182 ↗
67. The Role of Large Language Models (LLMs) in Breast Imaging Today and in the Near Future10.1002/jmri.29807 ↗
68. Artificial Intelligence in Breast US Diagnosis and Report Generation10.1148/ryai.240625 ↗
69. Godoy, E., de Ferrari, J., Mellado, D., Chabert, S., and Salas, R. (2024, January 15–18). Automatic Detection of Contextual Laterality in Mammography Reports Using Large Language Models. Proceedings of the 2024 14th International Conference on Pattern Recognition Systems (ICPRS), London, UK.10.1109/ICPRS62101.2024.10677842 ↗
70. Godoy, E., de Ferrari, J., Lazo, S., Pacheco, C., Mellado, D., Saez, A., Chabert, S., and Salas, R. (2024). A Framework for Extraction of Clinical Information from Radiological Mammography Reports Using Large Language Models and Retrieval Augmented Generation. Res. Sq., preprint.10.21203/rs.3.rs-4927320/v1 ↗