Interpretable Dimensionality Reduction in 3D Image Recognition with Small Sample Sizes
Source abstract
Abstract
Abstract A systematic feature-engineering approach to generate informative 2D representations of 3D data is introduced. In this method, the sequences of voxels along one axis of the 3D image are treated as spatial variation sequences. These sequences are projected into a 783-dimensional feature space using algorithms from statistics, signal processing, complexity theory as well as time-series forecasting and financial time-series analysis. The resulting two-dimensional image has 783 layers from which the most relevant three layers are chosen using a combination of univariate and multivariate feature selection. This process effectively converts the volumetric data into a two-dimensional three-layer image which can then be used as input to established object detection models. The validation of the method is conducted on an object detection application, involving the identification of biomatter threats in 3D X-ray scans of international travellers’ baggage. The 3D scans were recorded at the Airport in Auckland, New Zealand, and comprised 1525 biomatter threats distributed over 690 different bags. Various object detection models from the YOLO series are tested on this dataset. The YOLOv5l model achieved the highest mAP@0.5 of 0.878 on the validation dataset. Our results demonstrate that the methodologies of time-series classification and pattern recognition can be combined to implement efficient pattern recognition on 3D data sets with small sample sizes.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Image and Video Retrieval Techniques · Advanced Neural Network Applications · Medical Image Segmentation Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (36)
Show source-provided references
1. Schwaninger, A., Bolfing, A., Halbherr, T., Helman, S., Belyavin, A., Hay, L.: The impact of image based factors and training on threat detection performance in X-ray screening. In: Third International Conference on Research in Air Transportation (ICRAT 2008), Fairfax, Virginia, US, pp. 317–324 (2008). https://web.archive.org/web/20180820090611/http://www. icrat.org/icrat/seminarContent/2008/The Impact of Image.pdf
2. Wales, A., Halbherr, T., Schwaninger, A.: Using speed measures to predict per formance in X-ray luggage screening tasks. In: 43rd Annual 2009 International Carnahan Conference on Security Technology, pp. 212–215 (2009). IEEE10.1109/CCST.2009.5335536 ↗
3. Jay, M., Morad, M., Bell, A.: Biosecurity, a policy dilemma for New Zealand. Land Use Policy 20(2), 121–129 (2003)10.1016/S0264-8377(03)00008-5 ↗
4. Goldson, S., Bourdˆot, G., Brockerhoff, E., Byrom, A., Clout, M., McGlone, M., Nelson, W., Popay, A., Suckling, D., Templeton, M.: New Zealand pest manage ment: current and future challenges. J. R. Soc. N. Z. 45(1), 31–58 (2015)10.1080/03036758.2014.1000343 ↗
5. Setio, A.A.A., Traverso, A., De Bel, T., Berens, M.S., Van Den Bogaard, C., Cerello, P., Chen, H., Dou, Q., Fantacci, M.E., Geurts, B., et al.: Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge. Med. Image Anal. 42, 1–13 (2017)10.1016/j.media.2017.06.015 ↗
6. Simpson, A.L., Antonelli, M., Bakas, S., Bilello, M., Farahani, K., Van Gin neken, B., Kopp-Schneider, A., Landman, B.A., Litjens, G., Menze, B., et al.: A large annotated medical image dataset for the development and evaluation of segmentation algorithms. arXiv preprint arXiv:1902.09063 (2019)
7. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: Imagenet: A large scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255 (2009). IEEE10.1109/CVPR.2009.5206848 ↗
8. Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll´ar, P., Zitnick, C.L.: Microsoft COCO: Common objects in context. In: European Conference on Computer Vision, pp. 740–755 (2014). Springer10.1007/978-3-319-10602-1_48 ↗
9. Tajbakhsh, N., Jeyaseelan, L., Li, Q., Chiang, J.N., Wu, Z., Ding, X.: Embrac ing imperfect datasets: a review of deep learning solutions for medical image segmentation. Med. Image Anal. 63, 101693 (2020)10.1016/j.media.2020.101693 ↗
10. Zhang, Q., Wang, X., Jiang, J., Ma, L.: Deep learning features inspired saliency detection of 3D images. In: Pacific Rim Conference on Multimedia, pp. 580–589 (2016). Springer10.1007/978-3-319-48896-7_57 ↗
11. Rohila, V.S., Gupta, N., Kaul, A., Sharma, D.K.: Deep learning assisted COVID 19 detection using full CT-scans. Internet Things 14, 100377 (2021)10.1016/j.iot.2021.100377 ↗
12. Jakubicek, R., Chmelik, J., Jan, J., Ourednicek, P., Lambert, L., Gavelli, G.: Learning–based vertebra localization and labeling in 3D CT data of possi bly incomplete and pathological spines. Comput. Methods Programs Biomed. 183, 105081 (2020)10.1016/j.cmpb.2019.105081 ↗
13. Wang, X., Shen, T., Yang, S., Lan, J., Xu, Y., Wang, M., Zhang, J., Han, X.: A deep learning algorithm for automatic detection and classification of acute intracranial hemorrhages in head CT scans. NeuroImage 32, 102785 (2021)10.1016/j.nicl.2021.102785 ↗
14. Nigri, E., Ziviani, N., Cappabianco, F., Antunes, A., Veloso, A.: Explainable deep CNNs for MRI-based diagnosis of Alzheimer’s disease. In: 2020 International Joint Conference on Neural Networks (IJCNN), pp. 1–8 (2020). IEEE10.1109/IJCNN48605.2020.9206837 ↗
15. Gené-Mola, J., Sanz-Cortiella, R., Rosell-Polo, J.R., Morros, J.-R., Ruiz-Hidalgo, J., Vilaplana, V., Gregorio, E.: Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry. Comput. Electron. Agric. 169, 5165 (2020)10.1016/j.compag.2019.105165 ↗
16. Abid, M.M.N., Zia, T., Ghafoor, M., Windridge, D.: Multi-view convolutional recurrent neural networks for lung cancer nodule identification. Neurocomputing 453, 299–311 (2021)10.1016/j.neucom.2020.06.144 ↗
17. Garcıa, G., Colomer, A., Naranjo, V.: Glaucoma detection from raw SD-OCT volumes: a novel approach focused on spatial dependencies. Comput. Methods Programs Biomed. 200, 105855 (2021)10.1016/j.cmpb.2020.105855 ↗
18. Hussein, S., Cao, K., Song, Q., Bagci, U.: Risk stratification of lung nodules using 3D CNN-based multi-task learning. In: International Conference on Information Processing in Medical Imaging, pp. 249–260 (2017). Springer10.1007/978-3-319-59050-9_20 ↗
19. Ebrahimi, A., Luo, S., Chiong, R.: Introducing transfer learning to 3D ResNet 18 for Alzheimer’s disease detection on MRI images. In: 2020 35th International Conference on Image and Vision Computing New Zealand (IVCNZ), pp. 1–6 (2020). IEEE10.1109/IVCNZ51579.2020.9290616 ↗
20. Weiss, K., Khoshgoftaar, T.M., Wang, D.: A survey of transfer learning. J. Big Data 3(1), 1–40 (2016)10.1186/s40537-016-0043-6 ↗
21. Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)10.1109/CVPR.2016.91 ↗
22. Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger. In: Proceedings of 16th IEEE Conference on Computer Vision and Pattern Recognition, pp. 7263– 7271 (2017)10.1109/CVPR.2017.690 ↗
23. Redmon, J., Farhadi, A.: YOLOv3: An incremental improvement. arXiv preprint arXiv:1804.02767 (2018)
24. Bochkovskiy, A., Wang, C.-Y., Liao, H.-Y.M.: Yolov4: Optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934 (2020)
25. Jocher, G.: Ultralytics YOLOv5 (2020). https://doi.org/10.5281/zenodo.3908559. https://github.com/ultralytics/yolov510.5281/zenodo.3908559 ↗
26. He, K., Zhang, X., Ren, S., Sun, J.: Spatial pyramid pooling in deep convolu tional networks for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1904–1916 (2015)10.1109/TPAMI.2015.2389824 ↗
27. Akcay, S., Kundegorski, M.E., Willcocks, C.G., Breckon, T.P.: Using deep convo lutional neural network architectures for object classification and detection within x-ray baggage security imagery. IEEE Trans. Inf. Forensics Secur. 13(9), 2203–2215 (2018)10.1109/TIFS.2018.2812196 ↗
28. Koptev, I., Walker, C., Kempa-Liehr, A.W.: Image recognition and threat detec tion in bags arriving at the airport. In: Pacific-Rim Symposium on Image and Video Technology, pp. 29–42 (2023). Springer10.1007/978-981-97-0376-0_3 ↗
29. Li, M., Jia, T., Wang, H., Ma, B., Lu, H., Lin, S., Cai, D., Chen, D.: Ao-detr: Anti-overlapping detr for x-ray prohibited items detection. IEEE Transactions on Neural Networks and Learning Systems (2024)10.1109/TNNLS.2024.3487833 ↗
30. Li, M., Jia, T., Lu, H., Ma, B., Wang, H., Chen, D.: Mmcl: boosting deformable detr-based detectors with multi-class min-margin contrastive learning for superior prohibited item detection. arXiv preprint arXiv:2406.03176 (2024)
31. Otsu, N., et al.: A threshold selection method from gray-level histograms. Automatica 11(285–296), 23–27 (1975)
32. Christ, M., Braun, N., Neuffer, J., Kempa-Liehr, A.W.: Time series feature extraction on basis of scalable hypothesis tests (tsfresh–a python package). Neurocomputing 307, 72–77 (2018)10.1016/j.neucom.2018.03.067 ↗
33. Kennedy, A., Nash, G., Rattenbury, N., Kempa-Liehr, A.W.: Modelling the projected separation of microlensing events using systematic time-series fea ture engineering. Astron. Comput. 35(100460), 1–14 (2021)
34. Jeune, H., Pechan, N., Reitsma, S.-K., Kempa-Liehr, A.W.: Spatial variation sequences for remote sensing applications with small sample sizes. In: Pacific-Rim Symposium on Image and Video Technology, pp. 153–166 (2023). Springer10.1007/978-981-97-0376-0_12 ↗
35. Benjamini, Y., Yekutieli, D.: The control of the false discovery rate in multi ple testing under dependency. Ann. Stat. 29(4), 1165–1188 (2001). https://doi.org/10.1214/aos/101369999810.1214/aos/1013699998 ↗
36. Lempel, A., Ziv, J.: On the complexity of finite sequences. IEEE Trans. Inf. Theory 22(1), 75–81 (1976)10.1109/TIT.1976.1055501 ↗