journal article·2026-01-12Open access

ESCFM-YOLO: Lightweight Dual-Stream Architecture for Real-Time Small-Scale Fire Smoke Detection on Edge Devices

Jong-Chan Park, Myeongjun Kim, Sang-Min Choi, Gun-Woo Kim

Applied Sciences· Volume 16· Issue 2

Abstract

Early detection of small-scale fires is crucial for minimizing damage and enabling rapid emergency response. While recent deep learning-based fire detection systems have achieved high accuracy, they still face three key challenges: (1) limited deployability in resource-constrained edge environments due to high computational costs, (2) performance degradation caused by feature interference when jointly learning flame and smoke features in a single backbone, and (3) low sensitivity to small flames and thin smoke in the initial stages. To address these issues, we propose a lightweight dual-stream fire detection architecture based on YOLOv5n, which learns flame and smoke features separately to improve both accuracy and efficiency under strict edge constraints. The proposed method integrates two specialized attention modules: ESCFM++, which enhances spatial and channel discrimination for sharp boundaries and local flame structures (flame), and ESCFM-RS, which captures low-contrast, diffuse smoke patterns through depthwise convolutions and residual scaling (smoke). On the D-Fire dataset, the flame detector achieved 74.5% mAP@50 with only 1.89 M parameters, while the smoke detector achieved 89.2% mAP@50. When deployed on an NVIDIA Jetson Xavier NX (NVIDIA Corporation, Santa Clara, CA, USA)., the system achieved 59.7 FPS (single-stream) and 28.3 FPS (dual-tream) with GPU utilization below 90% and power consumption under 17 W. Under identical on-device conditions, it outperforms YOLOv9t and YOLOv12n by 36–62% in FPS and 0.7–2.0% in detection accuracy. We further validate deployment via outdoor day/night long-range live-stream tests on Jetson using our flame detector, showing reliable capture of small, distant flames that appear as tiny cues on the screen, particularly in challenging daytime scenes. These results demonstrate overall that modality-specific stream specialization and ESCFM attention reduce feature interference while improving detection accuracy and computational efficiency for real-time edge-device fire monitoring.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Fire Detection and Safety Systems · Fire dynamics and safety research · Image Enhancement Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of AI Convergence Engineering, Gyeongsang National University, Jinju 52828, Republic of Korea

Department of Computer Science and Engineering, Gyeongsang National University, Jinju 52828, Republic of Korea

The Research Institute of Natural Science, Gyeongsang National University, Jinju 52828, Republic of Korea

Funding

Ministry of Education

References (70)

Show source-provided references
1. A review of thermal exposure and fire spread mechanisms in large outdoor fires and the built environment10.1016/j.firesaf.2023.103871 ↗
2. Liu, Y., Heilman, W.E., Potter, B.E., Clements, C.B., Jackson, W.A., French, N.H., Goodrick, S.L., Kochanski, A.K., Larkin, N.K., and Lahm, P.W. (2025). Recent advances in wildland fire smoke dynamics research in the United States. Atmosphere, 16.10.3390/atmos16111221 ↗
3. Bukowski, R.W., Peacock, R.D., Averill, J.D., Cleary, T.G., Bryner, N.P., and Reneke, P.A. (2025, November 01). Performance of Home Smoke Alarms: Analysis of the Response of Several Available Technologies in Residential Fire Settings, Available online: https://www.nist.gov/publications/performance-home-smoke-alarms-analysis-response-several-available-technologies-0?pub_id=100900.
4. Agbehadji, I.E., Mabhaudhi, T., Botai, J., and Masinde, M. (2023). A systematic review of existing early warning systems’ challenges and opportunities in cloud computing early warning systems. Climate, 11.10.3390/cli11090188 ↗
5. Research progress on electrochemical gas sensors for fire detection10.1016/j.ijoes.2025.101043 ↗
6. Vision-based fire management system using autonomous unmanned aerial vehicles: A comprehensive survey10.1007/s10462-025-11415-3 ↗
7. Khan, F., Xu, Z., Sun, J., Khan, F.M., Ahmed, A., and Zhao, Y. (2022). Recent advances in sensors for fire detection. Sensors, 22.10.3390/s22093310 ↗
8. CNN-based fire detection method on autonomous ships using composite channels composed of RGB and IR data10.1016/j.ijnaoe.2022.100489 ↗
9. Fire and smoke detection from videos: A literature review under a novel taxonomy10.1016/j.eswa.2024.124783 ↗
10. A lightweight fire detection algorithm for small targets based on YOLOv5s10.1038/s41598-024-64934-4 ↗
11. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
12. Redmon, J., and Farhadi, A. (2018). YOLOv3: An incremental improvement. arXiv.
13. Tian, Y., Ye, Q., and Doermann, D. (2025). YOLOv12: Attention-centric real-time object detectors. arXiv.
14. Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). YOLOv4: Optimal speed and accuracy of object detection. arXiv.
15. Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2023, January 17–24). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗
16. Wang, C.-Y., Yeh, I.-H., and Liao, H.-Y.M. (2024). YOLOv9: Learning what you want to learn using programmable gradient information. European Conference on Computer Vision, Springer.10.1007/978-3-031-72751-1_1 ↗
17. Khanam, R., and Hussain, M. (2024). YOLOv11: An overview of the key architectural enhancements. arXiv.
18. Jocher, G., Stoken, A., Borovec, J., NanoCode012, Chaurasia, A., Tao, X., Liu, C., Abhiram, V. YOLOv5, Version 5.0; [Source Code]; GitHub: Tokyo, Japan, 2020. Available online: https://github.com/ultralytics/yolov5.
19. Han, X., Wu, Y., Pu, N., Feng, Z., Zhang, Q., Bei, Y., and Cheng, L. (2024). Fire and smoke detection with burning intensity representation. arXiv.10.1145/3696409.3700165 ↗
20. Sultan, T., Chowdhury, M.S., Safran, M., Mridha, M.F., and Dey, N. (2024). Deep learning-based multistage fire detection system and emerging direction. Fire, 7.10.3390/fire7120451 ↗
21. Visual fire detection using deep learning: A survey10.1016/j.neucom.2024.127975 ↗
22. Zhao, C., Zhao, L., Zhang, K., Ren, Y., Chen, H., and Sheng, Y. (2025). Smoke and Fire-You Only Look Once: A lightweight deep learning model for video smoke and flame detection in natural scenes. Fire, 8.10.3390/fire8030104 ↗
23. Jangirova, S., Jankovic, B., Ullah, W., Khan, L.U., and Guizani, M. (2025). Real-time aerial fire detection on resource-constrained devices using knowledge distillation. arXiv.10.1016/j.jag.2025.104665 ↗
24. EdgeFireSmoke++: A novel lightweight algorithm for real-time forest fire detection and visualization using Internet of Things-human machine interface10.1016/j.eswa.2023.119747 ↗
25. Sun, H., Xu, R., Luo, J., and Cheng, H. (2025). Review of the application of UAV edge computing in fire rescue. Sensors, 25.10.3390/s25113304 ↗
26. Maltezos, E., Petousakis, K., Dadoukis, A., Karagiannidis, L., Ouzounoglou, M., Krommyda, M., Hadjipavlis, G., and Amditis, A. (2022). A smart building fire and gas leakage alert system with edge computing and NG112 emergency call capabilities. Information, 13.10.3390/info13040164 ↗
27. Li, C., Li, L., Jiang, H., Weng, K., Geng, Y., Li, L., Ke, Z., Li, Q., Cheng, M., and Nie, W. (2022). YOLOv6: A single-stage object detection framework for industrial applications. arXiv.
28. Reis, D., Kupec, J., Hong, J., and Daoudi, A. (2023). Real-time flying object detection with YOLOv8. arXiv.
29. YOLOv5-Fog: A multiobjective visual detection algorithm for fog driving scenes based on improved YOLOv510.1109/TIM.2022.3216413 ↗
30. YOLOFM: An improved fire and smoke object detection algorithm based on YOLOv5n10.1038/s41598-024-55232-0 ↗
31. YOLO-HF: Early detection of home fires using YOLO10.1109/ACCESS.2025.3566907 ↗
32. DCGC-YOLO: The efficient dual-channel bottleneck structure YOLO detection algorithm for fire detection10.1109/ACCESS.2024.3385856 ↗
33. Pan, W., Wang, X., and Huan, W. (2024). EFA-YOLO: An efficient feature attention model for fire and flame detection. arXiv.
34. Enhanced YOLOv7-tiny for small-scale fire detection via multi-scale channel spatial attention and dynamic upsampling10.1109/ACCESS.2025.3590036 ↗
35. DeepSmoke: Deep learning model for smoke detection and segmentation in outdoor environments10.1016/j.eswa.2021.115125 ↗
36. A lightweight network for smoke semantic segmentation10.1016/j.patcog.2022.109289 ↗
37. Fire detection using statistical color model in video sequences10.1016/j.jvcir.2006.12.003 ↗
38. Computer vision-based method for real-time fire and flame detection10.1016/j.patrec.2005.06.015 ↗
39. Image fire detection algorithms based on convolutional neural networks10.1016/j.csite.2020.100625 ↗
40. Jadon, A., Omama, M., Varshney, A., Ansari, M.S., and Sharma, R. (2019). FireNet: A specialized lightweight fire and smoke detection model for real-time IoT applications. arXiv.
41. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). CBAM: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
42. Research and application of deep learning object detection methods for forest fire smoke recognition10.1038/s41598-025-98086-w ↗
43. Development of early fire detection model for buildings using computer vision-based CCTV10.1016/j.jobe.2022.105647 ↗
44. Indoor fire detection utilizing computer vision-based strategies10.1016/j.jobe.2022.105154 ↗
45. A modified YOLOv5 architecture for efficient fire detection in smart cities10.1016/j.eswa.2023.120465 ↗
46. Li, C., Du, Y., Zhang, X., and Wu, P. (2025). YOLOGX: An improved forest fire detection algorithm based on YOLOv8. Front. Environ. Sci., 12.10.3389/fenvs.2024.1486212 ↗
47. A multi-object detection method for building fire warnings through artificial intelligence generated content10.1038/s41598-025-02865-4 ↗
48. Dynamic fire and smoke detection module with enhanced feature integration and attention mechanisms10.1007/s10044-025-01461-6 ↗
49. YOLO-SAD for fire detection and localization in real-world images10.1016/j.dsp.2025.105320 ↗
50. Park, J.C., Kim, M.J., and Kim, G.W. (2024, January 16–18). MSA-YOLOv5: An improved lightweight YOLOv5 model for small object detection. Proceedings of the 15th International Conference on Information and Communication Technology Convergence (ICTC), Jeju Island, Republic of Korea.10.1109/ICTC62082.2024.10827062 ↗
51. Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7–12). Faster R-CNN: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Montreal, Canada.
52. Tan, M., Pang, R., and Le, Q.V. (2020, January 13–19). EfficientDet: Scalable and efficient object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01079 ↗
53. Lv, W., Zhao, Y., Chang, Q., Huang, K., Wang, G., and Liu, Y. (2024). RT-DETRv2: Improved baseline with bag-of-freebies for real-time detection transformer. arXiv.
54. Li, X., Wang, W., Hu, X., and Yang, J. (2019, January 15–20). Selective kernel networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00060 ↗
55. Shaw, P., Uszkoreit, J., and Vaswani, A. (2018). Self-attention with relative position representations. arXiv.10.18653/v1/N18-2074 ↗
56. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
57. Research and optimization of a multilevel fire detection framework based on deep learning and classical pattern recognition techniques10.1038/s41598-025-06721-3 ↗
58. Howard, A., Sandler, M., Chu, G., Chen, L.-C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for MobileNetV3. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
59. Misra, D. (2019). Mish: A self-regularized non-monotonic activation function. arXiv.10.5244/C.34.191 ↗
60. Research on litchi image detection in orchard using UAV based on improved YOLOv510.1016/j.eswa.2024.125828 ↗
61. Qiu, S., Xu, X., and Cai, B. (2018, January 20–24). FReLU: Flexible rectified linear units for improving convolutional neural networks. Proceedings of the 24th International Conference on Pattern Recognition (ICPR), Beijing, China.10.1109/ICPR.2018.8546022 ↗
62. Ma, N., Zhang, X., Liu, M., and Sun, J. (2021, January 20–25). Activate or not: Learning customized activation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00794 ↗
63. Hendrycks, D., and Gimpel, K. (2016). Gaussian error linear units (GELUs). arXiv.
64. Maas, A.L., Hannun, A.Y., and Ng, A.Y. (2013, January 16–21). Rectifier nonlinearities improve neural network acoustic models. Proceedings of the 30th International Conference on Machine Learning (ICML), Atlanta, GA, USA.
65. Nair, V., and Hinton, G.E. (2010, January 21–24). Rectified linear units improve restricted Boltzmann machines. Proceedings of the 27th International Conference on Machine Learning (ICML), Haifa, Israel.
66. Xu, B., Wang, N., Chen, T., and Li, M. (2015). Empirical evaluation of rectified activations in convolutional network. arXiv.
67. Godfrey, L.B., and Gashler, M.S. (2015, January 12–14). A continuum among logarithmic, linear, and exponential functions, and its potential to improve generalization in neural networks. Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K), Lisbon, Portugal.10.5220/0005635804810486 ↗
68. YouTube (2025, July 01). Fire Scene VR Video. Available online: https://www.youtube.com/watch?v=R6qJUl9C8HQ&ab_channel=kobecitychannel.
69. YouTube (2025, July 01). Vent-Enter-Search Rescue Video. Available online: https://www.youtube.com/watch?v=ECg8bI-ZY0o&ab_channel=StocktonFireHistory.
70. YouTube (2025, July 01). Working Structure Fire Video. Available online: https://www.youtube.com/watch?v=S6P2V4I36L4&ab_channel=StocktonFireHistory.