journal article·2024-11-15Open access

Using Compressed JPEG and JPEG2000 Medical Images in Deep Learning: A Review

Ilona Anna Urbaniak

Applied Sciences· Volume 14· Issue 22

Abstract

Machine Learning (ML), particularly Deep Learning (DL), has become increasingly integral to medical imaging, significantly enhancing diagnostic processes and treatment planning. By leveraging extensive datasets and advanced algorithms, ML models can analyze medical images with exceptional precision. However, their effectiveness depends on large datasets, which require extended training times for accurate predictions. With the rapid increase in data volume due to advancements in medical imaging technology, managing the data has become increasingly challenging. Consequently, irreversible compression of medical images has become essential for efficiently handling the substantial volume of data. Extensive research has established recommended compression ratios tailored to specific anatomies and imaging modalities, and these guidelines have been widely endorsed by government bodies and professional organizations globally. This work investigates the effects of irreversible compression on DL models by reviewing the relevant literature. It is crucial to understand how DL models respond to image compression degradations, particularly those introduced by JPEG and JPEG2000—both of which are the only permissible irreversible compression techniques in the most commonly used medical image format—the Digital Imaging and Communications in Medicine (DICOM) standard. This study provides insights into how DL models react to such degradations, focusing on the loss of high-frequency content and its implications for diagnostic interpretation. The findings suggest that while existing studies offer valuable insights, future research should systematically explore varying compression levels based on modality and anatomy, and consider developing strategies for integrating compressed images into DL model training for medical image analysis.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: AI in cancer detection · Advanced Data Compression Techniques · Medical Image Segmentation Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science, Faculty of Computer Science and Telecommunications, Cracow University of Technology, ul. Warszawska 24, 31-155 Cracow, Poland

References (73)

Show source-provided references
1. Irreversible compression in digital radiology. A literature review10.1016/j.radi.2005.04.002 ↗
2. An overview of digital compression of medical images: Can we use lossy image compression in radiology?
3. McInnes, M. (2005). Digital Compression of Medical Images: An Assessment of Legal Risk, Ivey School, Unversity of Western Ontario.
4. Determining optimal medical image compression: Psychometric and image distortion analysis10.1186/1471-2342-12-24 ↗
5. Clinical evaluation of compression ratios using JPEG2000 on computed radiography chest images10.1007/s10278-002-0007-6 ↗
6. European Society of Radiology (2011). Usability of irreversible image compression in radiological imaging. A position paper by the European Society of Radiology (ESR). Insights Imaging, 2, 103–115.10.1007/s13244-011-0071-x ↗
7. Pan-Canadian evaluation of irreversible compression ratios (“lossy” compression) for development of national guidelines10.1007/s10278-008-9139-7 ↗
8. Overview of the DICOM standard
9. Suapang, P., Dejhan, K., and Yimmun, S. (2009, January 18–21). Medical image compression and DICOM-format image archive. Proceedings of the 2009 ICCAS-SICE, Fukuoka, Japan.
10. Evaluation of irreversible compression ratios for medical images thin slice CT and update of Canadian Association of Radiologists (CAR) guidelines10.1007/s10278-012-9542-y ↗
11. The Royal Australian and New Zealand College of Radiologists (2020). Guideline for the Use of Image Compression in Diagnostic Imaging, Version 2, The Royal Australian and New Zealand College of Radiologists. Technical Report.
12. AACR–AAPM–SIIM Technical Standard for Electronic Practice of Medical Imaging10.1007/s10278-012-9522-2 ↗
13. Radiologists, R. (2008). The Adoption of Lossy Image Data Compression for the Purpose of Clinical Interpretation, Royal College of Radiologists.
14. Compression of digital images in radiology-results of a consensus conference10.1055/s-2008-1027847 ↗
15. An medical image file formats and digital image conversion10.35940/ijeat.A1093.1291S419 ↗
16. Feeman, T.G. (2010). The Mathematics of Medical Imaging, Springer.10.1007/978-0-387-92712-1 ↗
17. An analytical look at the effects of compression on medical images10.1007/BF03168659 ↗
18. The JPEG still picture compression standard10.1145/103085.103089 ↗
19. The JPEG still picture compression standard10.1109/30.125072 ↗
20. The JPEG 2000 still image compression standard10.1109/79.952804 ↗
21. Quality of compressed medical images10.1007/s10278-007-9013-z ↗
22. Detection of masses and clustered microcalcifications on data compressed mammograms: An observer performance study10.2214/ajr.175.6.1751573 ↗
23. The impact of image information on compressibility and degradation in medical image compression10.1118/1.2218316 ↗
24. Irreversible compression of medical images10.1007/s10278-002-0001-z ↗
25. JPEG 2000 compression of abdominal CT: Difference in tolerance between thin-and thick-section images10.2214/AJR.07.2304 ↗
26. Evaluation of JPEG and wavelet compression of body CT images for direct digital teleradiologic transmission10.1148/radiology.217.3.r00nv22772 ↗
27. Detection of radiographic abnormalities in mammograms by means of optical scanning and computer analysis10.1148/89.2.211 ↗
28. Kimme, C., O’loughlin, B.J., and Sklansky, J. (1977). Automatic detection of suspicious abnormalities in breast radiographs. Data Structures, Computer Graphics, and Pattern Recognition, Elsevier.10.1016/B978-0-12-415050-8.50019-7 ↗
29. Mammogram inspection by computer10.1109/TBME.1979.326560 ↗
30. Artificial intelligence and machine learning for medical imaging: A technology review10.1016/j.ejmp.2021.04.016 ↗
31. AI in Medical Imaging Informatics: Current Challenges and Future Directions10.1109/JBHI.2020.2991043 ↗
32. Machine learning and deep learning approach for medical image analysis: Diagnosis to detection10.1007/s11042-022-14305-w ↗
33. Deep learning in medical imaging10.14245/ns.1938396.198 ↗
34. A survey on deep learning in medical image analysis10.1016/j.media.2017.07.005 ↗
35. Deep learning applications in medical image analysis10.1109/ACCESS.2017.2788044 ↗
36. Zhang, H., and Qie, Y. (2023). Applying deep learning to medical imaging: A review. Appl. Sci., 13.10.3390/app131810521 ↗
37. Radford, A., Metz, L., and Chintala, S. (2015). Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv.
38. Riesenhuber, M., and Poggio, T. (2024, August 24). Computational Models of Object Recognition in Cortex: A Review. Available online: http://hdl.handle.net/1721.1/7231.
39. Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex10.1113/jphysiol.1962.sp006837 ↗
40. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position10.1007/BF00344251 ↗
41. Celeghin, A., Borriero, A., Orsenigo, D., Diano, M., Méndez Guerrero, C.A., Perotti, A., Petri, G., and Tamietto, M. (2023). Convolutional neural networks for vision neuroscience: Significance, developments, and outstanding issues. Front. Comput. Neurosci., 17.10.3389/fncom.2023.1153572 ↗
42. Convolutional neural networks: An overview and application in radiology10.1007/s13244-018-0639-9 ↗
43. A comprehensive review of deep neural networks for medical image processing: Recent developments and future opportunities10.1016/j.health.2023.100216 ↗
44. Glorot, X., Bordes, A., and Bengio, Y. (2011, January 1–13). Deep sparse rectifier neural networks. Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, JMLR Workshop and Conference Proceedings, Fort Lauderdale, FL, USA.
45. Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions10.1186/s40537-021-00444-8 ↗
46. ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
47. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
48. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
49. Convolutional neural networks for medical image analysis: Full training or fine tuning?10.1109/TMI.2016.2535302 ↗
50. Ghafoorian, M., Mehrtash, A., Kapur, T., Karssemeijer, N., Marchiori, E., Pesteie, M., Guttmann, C.R., de Leeuw, F.E., Tempany, C.M., and Van Ginneken, B. (2017, January 11–13). Transfer learning for domain adaptation in mri: Application in brain lesion segmentation. Proceedings of the Medical Image Computing and Computer Assisted Intervention-MICCAI 2017: 20th International Conference, Proceedings, Part III 20, Quebec City, QC, Canada.10.1007/978-3-319-66179-7_59 ↗
51. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015: 18th International Conference, Proceedings, Part III 18, Munich, Germany.
52. Lung CT image segmentation using deep neural networks10.1016/j.procs.2018.01.104 ↗
53. Artificial convolution neural network techniques and applications for lung nodule detection10.1109/42.476112 ↗
54. Deep learning in medical image analysis: A third eye for doctors10.1016/j.jormas.2019.06.002 ↗
55. Radiologists versus Deep Convolutional Neural Networks: A Comparative Study for Diagnosing COVID-1910.1155/2021/5527271 ↗
56. Roest, C., Fransen, S.J., Kwee, T.C., and Yakar, D. (2022). Comparative performance of deep learning and radiologists for the diagnosis and localization of clinically significant prostate cancer at MRI: A systematic review. Life, 12.10.3390/life12101490 ↗
57. Deep learning in medical image analysis10.1146/annurev-bioeng-071516-044442 ↗
58. Razzak, M.I., Naz, S., and Zaib, A. (2018). Deep learning for medical image processing: Overview, challenges and the future. Classification in BioApps: Automation of Decision Making, Springer.10.1007/978-3-319-65981-7_12 ↗
59. Recent advances and clinical applications of deep learning in medical image analysis10.1016/j.media.2022.102444 ↗
60. A review on deep learning in medical image analysis10.1007/s13735-021-00218-1 ↗
61. Zhou, S.K., Greenspan, H., and Shen, D. (2023). Deep Learning for Medical Image Analysis, Academic Press.
62. On deep learning for medical image analysis10.1001/jama.2018.13316 ↗
63. Lu, L., Zheng, Y., Carneiro, G., and Yang, L. (2017). Deep Learning and Convolutional Neural Networks for Medical Image Computing, Springer. Advances in Computer Vision and Pattern Recognition.10.1007/978-3-319-42999-1 ↗
64. A tour of unsupervised deep learning for medical image analysis
65. Zhang, Y., Gorriz, J.M., and Dong, Z. (2021). Deep learning in medical image analysis. J. Imaging, 7.10.3390/jimaging7040074 ↗
66. Mishra, S., Tripathy, H.K., and Acharya, B. (2021). A precise analysis of deep learning for medical image processing. Bio-Inspired Neurocomputing, Springer.10.1007/978-981-15-5495-7_2 ↗
67. Dodge, S., and Karam, L. (2016, January 6–8). Understanding how image quality affects deep neural networks. Proceedings of the 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX), Lisbon, Portugal.10.1109/QoMEX.2016.7498955 ↗
68. Dejean-Servières, M., Desnos, K., Abdelouahab, K., Hamidouche, W., Morin, L., and Pelcat, M. (2017). Study of the Impact of Standard Image Compression Techniques on Performance of Image Classification with a Convolutional Neural Network. [Ph.D. Thesis, Institut Pascal].
69. Pistono, M., Coatrieux, G., Nunes, J.C., and Cozic, M. (2020, January 24–27). Training Machine Learning on JPEG Compressed Images. Proceedings of the DCC, Snowbird, UT, USA.10.1109/DCC47342.2020.00070 ↗
70. Gueguen, L., Sergeev, A., Kadlec, B., Liu, R., and Yosinski, J. (2018, January 2–8). Faster neural networks straight from jpeg. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada.
71. Jo, Y.Y., Choi, Y.S., Park, H.W., Lee, J.H., Jung, H., Kim, H.E., Ko, K., Lee, C.W., Cha, H.S., and Hwangbo, Y. (2021). Impact of image compression on deep learning-based mammogram classification. Sci. Rep., 11.10.1038/s41598-021-86726-w ↗
72. Quantitative assessment of the effects of compression on deep learning in digital pathology image analysis10.1200/CCI.19.00068 ↗
73. Quality assessment of compressed and resized medical images based on pattern recognition using a convolutional neural network10.1016/j.cnsns.2020.105582 ↗