Advances in Neural Network-Based Image, Thermal, Infrared, and X-Ray Technologies
Source abstract
Abstract
With the dynamic development of imaging technologies and increasing demands in various industrial fields, neural networks are playing a crucial role in advanced design, monitoring, and analysis techniques. This review article presents the latest research advancements in neural network-based imaging, thermal, infrared, and X-ray technologies from 2005 to 2024. It focuses on two main research categories: ‘Technology’ and ‘Application’. The ‘Technology’ category includes neural network-enhanced image sensors, thermal imaging, infrared detectors, and X-ray technologies, while the ‘Application’ category is divided into image processing, robotics and design, object recognition, medical imaging, and security systems. In image processing, significant progress has been made in classification, segmentation, digital image storage, and information classification using neural networks. Robotics and design have seen advancements in mobile robots, navigation, and machine design through neural network integration. Object recognition technologies include neural network-based object detection, face recognition, and pattern recognition. Medical imaging has benefited from innovations in diagnosis, imaging techniques, and disease detection using neural networks. Security systems have improved in terms of monitoring and efficiency through neural network applications. This review aims to provide a comprehensive understanding of the current state and future directions of neural network-based imaging, thermal, infrared, and X-ray technologies.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Image Fusion Techniques · Infrared Thermography in Medicine · Infrared Target Detection Methodologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information Systems, Kielce University of Technology, 7 Tysiąclecia Państwa Polskiego Ave., 25-314 Kielce, Poland
Institute of Internal Security, Old Polish University of Applied Sciences, 49 Ponurego Piwnika Str., 25-666 Kielce, Poland
Institute of Crisis Management and Computer Modelling, 28-100 Busko-Zdrój, Poland
References (100+)
Show source-provided references
1. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
2. Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., and Change Loy, C. (2018, January 8–14). ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks. Proceedings of the European Conference on Computer Vision (ECCV) Workshops, Munich, Germany.10.1007/978-3-030-11021-5_5 ↗
3. Donahue, J., Hendricks, L.A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., and Saenko, K. (2015, January 7–12). Long-term recurrent convolutional networks for visual recognition and description. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298878 ↗
4. A hybrid learning approach to tissue recognition in wound images10.1108/17563780910959929 ↗
5. Machine vision 3D skin texture analysis for detection of melanoma10.1108/02602281111109961 ↗
6. Kristo, M., and Ivasic-Kos, M. (2018, January 21–25). An overview of thermal face recognition methods. Proceedings of the 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia.10.23919/MIPRO.2018.8400200 ↗
7. Concealed pistol detection from thermal images with deep neural networks10.1007/s11042-023-15358-1 ↗
8. An Energy-Quality Scalable Wireless Image Sensor Node for Object-Based Video Surveillance10.1109/JETCAS.2018.2832439 ↗
9. Datta, G., Liu, Z., Yin, Z., Sun, L., Jaiswal, A.R., and Beerel, P.A. (2023, January 2–7). Enabling ISPless Low-Power Computer Vision. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV56688.2023.00246 ↗
10. Li, Y., Hussain, H., Yang, C., Hu, S., and Zhao, J. (2019). High-Resolution Image Reconstruction Array of Based on Low-Resolution Infrared Sensor, Springer. Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST (LNICST, Volume 303).10.1007/978-3-030-36442-7_8 ↗
11. Intelligent Human Counting through Environmental Sensing in Closed Indoor Settings10.1007/s11036-019-01311-w ↗
12. Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising10.1109/TIP.2017.2662206 ↗
13. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
14. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
15. He, K., Gkioxari, G., Doll’ar, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.322 ↗
16. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3–6). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the Advances in Neural Information Processing Systems (NIPS), Lake Tahoe, NV, USA.
17. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
18. Image Super-Resolution Using Deep Convolutional Networks10.1109/TPAMI.2015.2439281 ↗
19. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8–13). Generative Adversarial Nets. Proceedings of the Advances in Neural Information Processing Systems (NIPS), Montreal, QC, Canada.
20. Deep Convolutional Neural Network for Inverse Problems in Imaging10.1109/TIP.2017.2713099 ↗
21. Gradient-Based Learning Applied to Document Recognition10.1109/5.726791 ↗
22. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
23. Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
24. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
25. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv.
26. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021, January 4). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria.
27. Pan, C., and Xia, B. (2009, January 7–8). Comparison of pixels unmixing approaches and application to MODIS. Proceedings of the 2009 International Conference on Artificial Intelligence and Computational Intelligence, Shanghai, China.10.1109/AICI.2009.424 ↗
28. Processing near sensor architecture in mixed-signal domain with CMOS image sensor of convolutional-kernel-readout method10.1109/TCSI.2019.2937227 ↗
29. Kisku, W., Kaur, A., and Mishra, D. (2021, January 6–9). On-chip Pixel Reconstruction using Simple CNN for Sparsely Read CMOS Image Sensor. Proceedings of the 2021 IEEE 3rd International Conference on Artificial Intelligence Circuits and Systems (AICAS), Washington, DC, USA.10.1109/AICAS51828.2021.9458532 ↗
30. A 240-FPS In-Column Binarized Neural Network Processing in CMOS Image Sensors
31. Rojas, R.A., Luo, W., Murray, V., and Lu, Y.M. (2017, January 17–20). Learning optimal parameters for binary sensing image reconstruction algorithms. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.10.1109/ICIP.2017.8296791 ↗
32. Chen, H.G., Jayasuriya, S., Yang, J., Stephen, J., Sivaramakrishnan, S., Veeraraghavan, A., and Molnar, A. (2016, January 27–30). ASP vision: Optically computing the first layer of convolutional neural networks using angle sensitive pixels. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.104 ↗
33. Guo, J., Gu, H., and Potkonjak, M. (2018, January 23–25). Efficient image sensor subsampling for DNN-based image classification. Proceedings of the ISLPED ’18: International Symposium on Low Power Electronics and Design, Seattle, WA, USA.10.1145/3218603.3218618 ↗
34. Ahmad, J., and Warren, A. (2018, January 27–30). FPGA based Deterministic Latency Image Acquisition and Processing System for Automated Driving Systems. Proceedings of the 2018 IEEE International Symposium on Circuits and Systems (ISCAS), Florence, Italy.10.1109/ISCAS.2018.8351472 ↗
35. An event-driven multi-kernel convolution processor module for event-driven vision sensors10.1109/JSSC.2011.2167409 ↗
36. Hardware-Compliant Compressive Image Sensor Architecture Based on Random Modulations and Permutations for Embedded Inference10.1109/TCSI.2020.2971565 ↗
37. On-Array Compressive Acquisition in CMOS Image Sensors Using Accumulated Spatial Gradients10.1109/TCSVT.2020.2989359 ↗
38. Lai, J.L., Guan, Z.X., Chen, Y.T., Tai, C.F., and Chen, R.J. (2008, January 25–27). Implementation of fuzzy cellular neural network with image sensor in CMOS technology. Proceedings of the 2008 International Conference on Communications, Circuits and Systems, Fujian, China.
39. A Bio-Inspired Spiking Vision Chip Based on SPAD Imaging and Direct Spike Computing for Versatile Edge Vision10.1109/JSSC.2023.3340018 ↗
40. Compiling CNNs with Cain: Focal-plane processing for robot navigation10.1007/s10514-022-10053-w ↗
41. Active tuning of intrinsic camera parameters10.1109/TASE.2009.2017735 ↗
42. Synaptic Scaling—An Artificial Neural Network Regularization Inspired by Nature10.1109/TNNLS.2021.3050422 ↗
43. Deep Neural Networks for Learning Spatio-Temporal Features From Tomography Sensors10.1109/TIE.2017.2716907 ↗
44. Cao, D., and Guo, P. (2006, January 16–18). Residual error based approach to classification of multisource remote sensing images. Proceedings of the Sixth International Conference on Intelligent Systems Design and Applications, Jian, China.10.1109/ISDA.2006.253871 ↗
45. Cracan, A.M., Teodoru, C., and Dobrea, D.M. (2005, January 21–24). Techniques to implement an embedded laser sensor for pattern recognition. Proceedings of the EUROCON 2005—The International Conference on “Computer as a Tool”, Belgrade, Serbia.10.1109/EURCON.2005.1630227 ↗
46. Facial masks and soft-biometrics: Leveraging face recognition CNNs for age and gender prediction on mobile ocular images10.1049/bme2.12046 ↗
47. A CNN-Based Framework for Comparison of Contactless to Contact-Based Fingerprints10.1109/TIFS.2018.2854765 ↗
48. Hybrid intelligent vision-based car-like vehicle backing systems design10.1016/j.eswa.2008.09.057 ↗
49. Application of neural network and electrodynamic sensor as flow pattern identifier10.1108/02602281011022733 ↗
50. Integrated worker detection and tracking for the safe operation of construction machinery10.1016/j.autcon.2021.103670 ↗
51. Learnable fusion mechanisms for multimodal object detection in autonomous vehicles10.1049/cvi2.12259 ↗
52. Nguwi, Y.Y., and Kouzani, A.Z. (2006, January 16–21). Automatic road sign recognition using neural networks. Proceedings of the 2006 IEEE International Joint Conference on Neural Network Proceedings, Vancouver, BC, Canada.10.1109/IJCNN.2006.246916 ↗
53. Obtaining weld pool vision information during aluminium alloy TIG welding10.1007/s00170-003-1548-7 ↗
54. Modeling of pulsed GTAW based on multi-sensor fusion10.1108/02602280910967639 ↗
55. Zhao, L., Zhang, Y., Bai, Q., Qi, Z., and Zhang, X. (2009, January 11–12). Research of digital meter identifier based on DSP and neural network. Proceedings of the 2009 IEEE International Workshop on Imaging Systems and Techniques, Shenzhen, China.10.1109/IST.2009.5071675 ↗
56. Zhao, L., Zhang, Y., Bai, Q., Qi, Z., and Zhang, X. (2009, January 15–16). Design and research of digital meter identifier based on image and wireless communication. Proceedings of the 2009 International Conference on Industrial Mechatronics and Automation, Chengdu, China.10.1109/ICIMA.2009.5156570 ↗
57. STARE: Realtime, wearable, simultaneous gaze tracking and object recognition from eye images10.5594/JMI.2017.2711899 ↗
58. Torghabeh, F.A., Modaresnia, Y., and Hosseini, S.A. (2023, January 1–2). An Efficient Approach for Breast Abnormality Detection through High-Level Features of Thermography Images. Proceedings of the 2023 13th International Conference on Computer and Knowledge Engineering (ICCKE), Mashhad, Iran.10.1109/ICCKE60553.2023.10326246 ↗
59. Naz, M., and Sakarkar, G. (2022, January 29–30). Arthritis Detection Using Thermography and Artificial Intelligence. Proceedings of the 2022 10th International Conference on Emerging Trends in Engineering and Technology - Signal and Information Processing (ICETET-SIP-22), Nagpur, India.10.1109/ICETET-SIP-2254415.2022.9791556 ↗
60. Region-wise severity analysis of diabetic plantar foot thermograms10.1515/bmt-2022-0376 ↗
61. Deep convolutional neural network-based diabetic eye disease detection and classification using thermal images
62. Kyal, C., Poddar, H., and Reza, M. (2022). Thermal Biometric Face Recognition (TBFR): A Noncontact Face Biometry, Elsevier.10.1016/B978-0-323-85209-8.00012-2 ↗
63. Pons, G., El Ali, A., and Cesar, P. (2020, January 25–29). ET-CycleGAN: Generating thermal images from images in the visible spectrum for facial emotion recognition. Proceedings of the ICMI ’20: International Conference On Multimodal Interaction, Virtual Event, The Netherlands.10.1145/3395035.3425258 ↗
64. Lin, S., Chen, L., Chen, W., and Chang, B. Face Recognition via Thermal Imaging: A Comparative Study of Traditional and CNN-Based Approaches. Proceedings of the ICMLSC ’24: Proceedings of the 2024 8th International Conference on Machine Learning and Soft Computing.10.1145/3647750.3647771 ↗
65. Rathore, S., and Bhalerao, S. (2015, January 23–24). Implementation of neuro-fuzzy based portable thermographic system for detection of Rheumatoid Arthritis. Proceedings of the 2015 Global Conference on Communication Technologies (GCCT), Thuckalay, India.10.1109/GCCT.2015.7342792 ↗
66. Detection of electrical equipment using an artificial neural network with visual spectrum images and thermal images10.1049/icp.2024.0448 ↗
67. Detection of Covid-19 Using an Infrared Fever Screening System (IFSS) Based on Deep Learning Technology10.1007/978-981-99-1624-5_16 ↗
68. COVID-19 symptom identification using Deep Learning and hardware emulated systems10.1016/j.engappai.2023.106709 ↗
69. Kostadinov, G. (2023). AI-Enabled Infrared Thermography: Machine Learning Approaches in Detecting Peripheral Arterial Disease, Springer. Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST (LNICST, Volume 514).10.1007/978-3-031-44668-9_12 ↗
70. Deep learning based super resolution and classification applications for neonatal thermal images10.18280/ts.380511 ↗
71. Diabetic foot thermal image segmentation using Double Encoder-ResUnet (DE-ResUnet)10.1080/03091902.2022.2077997 ↗
72. Dickens, J., Van Wyk, M., and Green, J. (2011, January 13–15). Pedestrian detection for underground mine vehicles using thermal images. Proceedings of the IEEE Africon ’11, Victoria Falls, Zambia.10.1109/AFRCON.2011.6072167 ↗
73. Sneha, M., Aravindakshan, G., Varsha Vardini, S., Akshayaa Rajeshwari, D., Sastika Var, R., Selvi, J.T., and Sathiyanarayanan, M. (2020, January 9–10). An effective drone surveillance system using thermal imaging. Proceedings of the 2020 International Conference on Smart Technologies in Computing, Electrical and Electronics (ICSTCEE), Bengaluru, India.
74. Transfer of learning in convolutional neural networks for thermal image classification in Electrical Transformer Rooms10.1016/j.aej.2024.07.077 ↗
75. Gorska, A., Guzal, P., Namiotko, I., Wedolowska, A., Wloszczynska, M., and Ruminski, J. (2022, January 28–31). Pedestrian detection in low-resolution thermal images. Proceedings of the 2022 15th International Conference on Human System Interaction (HSI), Melbourne, Australia.10.1109/HSI55341.2022.9869447 ↗
76. Ivašić-Kos, M., Krišto, M., and Pobar, M. (2019, January 16–17). Human detection in thermal imaging using YOLO. Proceedings of the ICCTA 2019: 2019 5th International Conference on Computer and Technology Applications, Istanbul, Turkey.10.1145/3323933.3324076 ↗
77. Deep learning techniques for automated detection of autism spectrum disorder based on thermal imaging10.1177/09544119211024778 ↗
78. Kuo, H.H., Barik, D.S., Zhou, J.Y., Hong, Y.K., Yan, J.J., and Yen, M.H. (2022, January 7–9). Design and Implementation of AI aided Fruit Grading Using Image Recognition. Proceedings of the 2022 IEEE/ACIS 23rd International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), Taichung, Taiwan.10.1109/SNPD54884.2022.10051810 ↗
79. Purcaru, C., Precup, R.E., Iercan, D., Fedorovici, L.O., Dohangie, B., and Dragan, F. (2013, January 23–25). Nrobotic mobile robot navigation using traffic signs in unknown indoor environments. Proceedings of the 2013 IEEE 8th International Symposium on Applied Computational Intelligence and Informatics (SACI), Timisoara, Romania.10.1109/SACI.2013.6608982 ↗
80. Design of Sensor Data Fusion Algorithm for Mobile Robot Navigation Using ANFIS and Its Analysis Across the Membership Functions10.3103/S0146411618050036 ↗
81. Crnokić, B. (2020). Use of Artificial Neural Networks for Fusion of Infrared and Vision Sensors in a Mobile Robot Navigation System, DAAAM International.10.2507/31st.daaam.proceedings.011 ↗
82. Mobile robot navigation based on CNN images processing—An experimental setup
83. A non-intrusive approach for fault detection and diagnosis of water distribution systems based on image sensors, audio sensors and an inspection robot10.1016/j.enbuild.2021.110967 ↗
84. Detection and control of flexible peristaltic pipeline robot in elbow10.4028/www.scientific.net/AMM.389.789 ↗
85. Koval, V., Adamiv, O., and Kapura, V. (2007, January 6–8). The local area map building for mobile robot navigation using ultrasound and infrared sensors. Proceedings of the 2007 4th IEEE Workshop on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications, Dortmund, Germany.10.1109/IDAACS.2007.4488459 ↗
86. Using educational robotics to motivate complete AI solutions
87. Nigam, P., Biswas, K., Gupta, S., Khandagre, Y., and Dubey, A.K. (2011, January 8–10). Radar-infrared sensor track correlation algorithm based on neural network fusion system. Proceedings of the 2011 3rd International Conference on Electronics Computer Technology, Kanyakumari, India.10.1109/ICECTECH.2011.5941831 ↗
88. Kim, T., Kim, S., Lee, E., and Park, M. (2017, January 18–21). Comparative analysis of RADAR-IR sensor fusion methods for object detection. Proceedings of the 2017 17th International Conference on Control, Automation and Systems (ICCAS), Jeju, Republic of Korea.10.23919/ICCAS.2017.8204237 ↗
89. Maritime vessel classification based on a dual network combining EfficientNet with a hybrid network MPANet10.1049/ipr2.13158 ↗
90. Half space object classification via incident angle based fusion of radar and infrared sensors10.23919/JSEE.2022.000100 ↗
91. Using positional tracking to improve abdominal ultrasound machine learning classification10.1088/2632-2153/ad379d ↗
92. Avuthu, B., Yenuganti, N., Kasikala, S., Viswanath, A. (2022, January 4–6). A Deep Learning approach for detection and analysis of respiratory infections in covid-19 patients using RGB and infrared images. Proceedings of the IC3-2022: 2022 Fourteenth International Conference on Contemporary Computing, Noida, India.10.1145/3549206.3549272 ↗
93. Zhang, J., Song, C., Hu, Y., and Yu, B. (2012, January 13–15). Improving robustness of robotic grasping by fusing multi-sensor. Proceedings of the 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), Hamburg, Germany.10.1109/MFI.2012.6343002 ↗
94. Rao-Blackwellized Particle Filter with Neural Network using Low-Cost Range Sensor in Indoor Environment
95. Jeffril, M.A., and Sariff, N. (2013, January 19–20). The integration of fuzzy logic and artificial neural network methods for mobile robot obstacle avoidance in a static environment. Proceedings of the 2013 IEEE 3rd International Conference on System Engineering and Technology, Shah Alam, Malaysia.10.1109/ICSEngT.2013.6650193 ↗
96. Savage, J., Cruz, J., Matamoros, M., Rosenblueth, D.A., Muñoz, S., and Negrete, M. (2016, January 4–6). Configurable Mobile Robot Behaviors Implemented on FPGA Based Architectures. Proceedings of the 2016 International Conference on Autonomous Robot Systems and Competitions (ICARSC), Bragança, Portugal.10.1109/ICARSC.2016.29 ↗
97. A modified neuro-evolutionary algorithm for mobile robot navigation: Using fuzzy systems and combination of artificial neural networks
98. Hofer, E., Rahman, T., Myers, R., and Hamieh, I. (September, January 30). Training a Neural Network for Lane Demarcation Detection in the Infrared Spectrum. Proceedings of the 2020 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), London, ON, Canada.10.1109/CCECE47787.2020.9255732 ↗
99. Design of a high-speed line following robot that smoothly follows tight curves10.1016/j.compeleceng.2015.06.014 ↗
100. Sobayo, R., Wu, H.H., Ray, R., and Qian, L. (2018, January 8–10). Integration of convolutional neural network and thermal images into soil moisture estimation. Proceedings of the 2018 1st International Conference on Data Intelligence and Security (ICDIS), South Padre Island, TX, USA.10.1109/ICDIS.2018.00041 ↗