A Video-Based Fire Detection Using Deep Learning Models
Source abstract
Abstract
Fire is an abnormal event which can cause significant damage to lives and property. In this paper, we propose a deep learning-based fire detection method using a video sequence, which imitates the human fire detection process. The proposed method uses Faster Region-based Convolutional Neural Network (R-CNN) to detect the suspected regions of fire (SRoFs) and of non-fire based on their spatial features. Then, the summarized features within the bounding boxes in successive frames are accumulated by Long Short-Term Memory (LSTM) to classify whether there is a fire or not in a short-term period. The decisions for successive short-term periods are then combined in the majority voting for the final decision in a long-term period. In addition, the areas of both flame and smoke are calculated and their temporal changes are reported to interpret the dynamic fire behavior with the final fire decision. Experiments show that the proposed long-term video-based method can successfully improve the fire detection accuracy compared with the still image-based or short-term video-based method by reducing both the false detections and the misdetections.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Fire Detection and Safety Systems · Video Surveillance and Tracking Methods · IoT-based Smart Home Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Division of Computer Science and Engineering, Chonbuk National University, Jeonju 54896, Korea
References (31)
Show source-provided references
1. Real-time multi-feature based fire flame detection in video10.1049/iet-ipr.2016.0193 ↗
2. Evarts, B. (2018). Fire loss in the United States during 2017, National Fire Protection Association, Fire Analysis and Research Division.
3. An autoadaptive edge-detection algorithm for flame and fire image processing10.1109/TIM.2011.2175833 ↗
4. Liu, C.B., and Ahuja, N. (2004, January 26). Vision based fire detection. Proceedings of the 17th International Conference on Pattern Recognition (ICPR), Cambridge, UK.
5. Fire detection using statistical color model in video sequences10.1016/j.jvcir.2006.12.003 ↗
6. Modeling and formalization of fuzzy finite automata for detection of irregular fire flames10.1109/TCSVT.2011.2157190 ↗
7. Chen, T.H., Wu, P.H., and Chiou, Y.C. (2004, January 24–27). An early fire-detection method based on image processing. Proceedings of the International Conference on Image Processing (ICIP), Singapore.
8. Wang, T., Shi, L., Hou, X., Yuan, P., and Bu, L. (2017, January 20–22). A new fire detection method based on flame color dispersion and similarity in consecutive frames. Proceedings of the 2017 Chinese Automation Congress (CAC), Jinan, China.10.1109/CAC.2017.8242754 ↗
9. A probabilistic approach for vision-based fire detection in videos10.1109/TCSVT.2010.2045813 ↗
10. Optical flow estimation for flame detection in videos10.1109/TIP.2013.2258353 ↗
11. Real-time fire detection for video surveillance applications using a combination of experts based on color, shape, and motion10.1109/TCSVT.2015.2392531 ↗
12. Frizzi, S., Kaabi, R., Bouchouicha, M., Ginoux, J.M., Moreau, E., and Fnaiech, F. (2016, January 23–26). Convolutional neural network for video fire and smoke detection. Proceedings of the IECON 2016—42nd Annual Conference of the IEEE Industrial Electronics Society, Florence, Italy.10.1109/IECON.2016.7793196 ↗
13. Zhang, Q., Xu, J., and Guo, H. (2016, January 30–31). Deep convolutional neural networks for forest fire detection. Proceedings of the 2016 International Forum on Management, Education and Information Technology Application, Guangzhou, China.10.2991/ifmeita-16.2016.105 ↗
14. Efficient Deep CNN-Based Fire Detection and Localization in Video Surveillance Applications
15. Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and<0.5 MB model size. arXiv.
16. Hochreiter, S., and Schmidhuber, J. (1997). LSTM can solve hard long time lag problems. Advances in Neural Information Processing Systems, NIPS.
17. Hu, C., Tang, P., Jin, W., He, Z., and Li, W. (2018, January 25–27). Real-Time Fire Detection Based on Deep Convolutional Long-Recurrent Networks and Optical Flow Method. Proceedings of the 2018 37th Chinese Control Conference (CCC), Wuhan, China.10.23919/ChiCC.2018.8483118 ↗
18. Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7–12). Faster R-CNN: Towards real-time object detection with region proposal networks. Proceedings of the Neural Information Processing Systems (NIPS), Montreal, QC, Canada.
19. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 8–16). SSD: Single shot multibox detector. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
20. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You only look once: Unified, real-time object detection. Proceedings of the Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.
21. (2018, March 28). Object Detection: Speed and Accuracy Comparison (Faster R-CNN, R-FCN, SSD, FPN, RetinaNet and YOLO). Available online: https://medium.com/@jonathan_hui/object-detection-speed-and-accuracy-comparison-faster-r-cnn-r-fcn-ssd-and-yolo-5425656ae359.
22. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
23. Zhou, B., Khosla, A., Lapedriza, A., Torralba, A., and Oliva, A. (July, January 26). Learning deep features for discriminative localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
24. Chino, D.Y.T., Avalhais, L.P.S., Rodrigues, J.F., and Traina, A.J.M. (2015, January 26–29). Bowfire: detection of fire in still images by integrating pixel color and texture analysis. Proceedings of the 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images, Salvador, Brazil.10.1109/SIBGRAPI.2015.19 ↗
25. Video driven fire spread forecasting (f) using multi-modal LWIR and visual flame and smoke data10.1016/j.patrec.2012.07.018 ↗
26. Bedo, M., Blanco, G., Oliveira, W., Cazzolato, M., Costa, A., Rodrigues, J., Traina, A., and Traina, C. (2015). Techniques for effective and efficient fire detection from social media images. arXiv preprint.
27. Di Lascio, R., Greco, A., Saggese, A., and Vento, M. (2014, January 22–24). Improving fire detection reliability by a combination of video analytics. Proceedings of the International Conference Image Analysis and Recognition, Vilamoura, Portugal.10.1007/978-3-319-11758-4_52 ↗
28. Covariance matrix-based fire and flame detection method in video10.1007/s00138-011-0369-1 ↗
29. Rafiee, A., Dianat, R., Jamshidi, M., Tavakoli, R., and Abbaspour, S. (2011, January 11–13). Fide and smoke detection using wavelet analysis and disorder characteristics. Proceedings of the 2011 3rd International Conference on Computer Research and Development (ICCRD), Shanghai, China.10.1109/ICCRD.2011.5764295 ↗
30. Jadon, A., Omama, M., Varshney, A., Ansari, M.S., and Sharma, R. (2019). FireNet: A Specialized Lightweight Fire & Smoke Detection Model for Real-Time IoT Applications. arXiv.
31. Efficient Fire Detection for Uncertain Surveillance Environment10.1109/TII.2019.2897594 ↗