journal article·2024-07-01Open access

An advanced heat source localization technology for intelligent warehousing: A multi-source fusion image segmentation approach leveraging infrared and visible light data

Junliang Chen, Haojun Xu, Xiaolong Wei, Qichun Hu, Yu Cai, Senlin Zhu

AIP Advances· Volume 14· Issue 7

Abstract

Infrared thermography technology, leveraging its unique ability to capture temperature features, has significantly improved the precision of high-temperature target localization. However, infrared imaging technology is limited by issues such as low image contrast, difficulty in distinguishing object categories, and limited image clarity. To enable intelligent detection of high-temperature objects that may cause fires in warehouses, this paper proposes an innovative method that integrates deep learning image segmentation with infrared and visible light image technology. We developed a new image segmentation model based on improved Fully Convolutional Networks and Deconvolutional Networks, introducing a batch normalization layer to accelerate convergence and employing the PReLU activation function to prevent neuron death, thereby enhancing convergence speed and accuracy. Through a feature dynamic image registration method combining a joint model and a cross-modulation strategy, we achieved efficient image fusion. In addition, a game theory-based strategy was adopted to correct localization results, ensuring accuracy. Experimental results demonstrate that the improved model achieves localization accuracy and precision rates of up to 89.30% and 88.00%, respectively, in real-world warehouse heat source scenarios, representing a significant improvement of 9.90% and 2.85% compared to the pre-improvement model, fully validating its advancement and effectiveness.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Fire Detection and Safety Systems · Thermography and Photoacoustic Techniques · Advanced Image Fusion Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

National Key Lab of Aerospace Power System and Plasma Technology, Air Force Engineering University , Xi’an, Shaanxi, China

Funding

National Science and Technology Major Project

References (35)

Show source-provided references
1. Remote Sens. · 2023 · 15 · 350110.3390/rs15143501 ↗
2. Measurement · 2018 · 120 · 14010.1016/j.measurement.2018.02.029 ↗
3. Infrared Phys. Technol. · 2013 · 61 · 25410.1016/j.infrared.2013.08.017 ↗
4. Multimed. Tools Appl. · 2022 · 82 · 1383710.1007/s11042-022-14018-0 ↗
5. Electronics · 2023 · 12 · 119910.3390/electronics12051199 ↗
6. A threshold selection method from gray-level histograms10.1109/TSMC.1979.4310076 ↗
7. IEEE Trans. Pattern Anal. Mach. Intell. · 2004 · 26 · 145210.1109/tpami.2004.110 ↗
8. Procedia Comput. Sci. · 2015 · 54 · 76410.1016/j.procs.2015.06.090 ↗
9. Watershed of a continuous function10.1016/0165-1684(94)90059-0 ↗
10. Genetic snakes: Active contour models by genetic algorithms
11. IEEE Trans. Pattern Anal. Mach. Intell. · 2001 · 23 · 122210.1109/34.969114 ↗
12. 2009
13. An ADMM approach to masked signal decomposition using subspace representation10.1109/tip.2019.2894966 ↗
14. IEEE Trans. Image Process. · 2005 · 14 · 157010.1109/tip.2005.852206 ↗
15. IEEE Trans. Pattern Anal. Mach. Intell. · 2017 · 39 · 64010.1109/tpami.2016.2572683 ↗
16. 2014
17. Electronics · 2022 · 11 · 93310.3390/electronics11060933 ↗
18. Infrared Phys. Technol. · 2014 · 66 · 7810.1016/j.infrared.2014.05.015 ↗
19. Infrared Phys. Technol. · 2022 · 123 · 10418110.1016/j.infrared.2022.104181 ↗
20. Infrared Phys. Technol. · 2022 · 123 · 10418210.1016/j.infrared.2022.104182 ↗
21. Infrared and visible image fusion methods and applications: A survey
22. Infrared Phys. Technol. · 2017 · 85 · 47810.1016/j.infrared.2017.07.010 ↗
23. Int. J. Wavelets Multiresolution Inf. Process. · 2018 · 16 · 185001810.1142/s0219691318500182 ↗
24. Different input resolutions and arbitrary output resolution: A meta learning-based deep framework for infrared and visible image fusion10.1109/TIP.2021.3069339 ↗
25. 2020
26. 2020
27. IEEE Trans. Instrum. Meas. · 2021 · 70 · 110.1109/tim.2021.3075747 ↗
28. Inf. Fusion · 2023 · 95 · 2610.1016/j.inffus.2023.02.011 ↗
29. Signal Process. · 2012 · 92 · 246410.1016/j.sigpro.2012.03.009 ↗
30. Relation-attention networks for remote sensing scene classification10.1109/JSTARS.2021.3135566 ↗
31. Soft color morphology: A fuzzy approach for multivariate images10.1007/s10851-018-0849-2 ↗
32. EURASIP J. Adv. Signal Process. · 2023 · 3810.1186/s13634-023-01002-5 ↗
33. 2020
34. 2016
35. 2008