journal article·2021-05-31Open access

Flame Detection Using Appearance-Based Pre-Processing and Convolutional Neural Network

Jinkyu Ryu, Dongkurl Kwak

Applied Sciences· Volume 11· Issue 11

Abstract

It is important for fire detectors to operate quickly in the event of a fire, but existing conventional fire detectors sometimes do not work properly or there are problems where non-fire or false reporting occurs frequently. Therefore, in this study, HSV color conversion and Harris Corner Detection were used in the image pre-processing step to reduce the incidence of false detections. In addition, among the detected corners, the vicinity of the corner point facing the upper direction was extracted as a region of interest (ROI), and the fire was determined using a convolutional neural network (CNN). These methods were designed to detect the appearance of flames based on top-pointing properties, which resulted in higher accuracy and higher precision than when input images were still used in conventional object detection algorithms. This also reduced the false detection rate for non-fires, enabling high-precision fire detection.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Fire Detection and Safety Systems · Video Surveillance and Tracking Methods · Traffic Prediction and Management Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Graduate School of Disaster Prevention, Kangwon National University, Samcheok-si 25913, Gangwon-do, Korea

References (32)

Show source-provided references
1. Deng, L., Hinton, G., and Kingsbury, B. (2013, January 26–31). New types of deep neural network learning for speech recognition and related applications: An overview. Proceedings of the 2013 IEEE International Conference on Acoustics Speech and Signal Processing 2013, Vancouver, BC, Canada.10.1109/ICASSP.2013.6639344 ↗
2. Neural network with deep learning architectures
3. InnoHAR: A Deep Neural Network for Complex Human Activity Recognition10.1109/ACCESS.2018.2890675 ↗
4. An overview of deep learning in medical imaging focusinzg on MRI10.1016/j.zemedi.2018.11.002 ↗
5. Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection10.1177/1475921717737051 ↗
6. Ma, X., Dai, Z., He, Z., Ma, J., Wang, Y., and Wang, Y. (2017). Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction. Sensors, 17.10.3390/s17040818 ↗
7. Ghorbanzadeh, O., Blaschke, T., Gholamnia, K., Meena, S., Tiede, D., and Aryal, J. (2019). Evaluation of Different Machine Learning Methods and Deep-Learning Convolutional Neural Networks for Landslide Detection. Remote Sens., 11.10.3390/rs11020196 ↗
8. Deep Learning with Convolutional Neural Network for Differentiation of Liver Masses at Dynamic Contrast-enhanced CT: A Preliminary Study10.1148/radiol.2017170706 ↗
9. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition 2014, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
10. Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
11. He, K., Gkioxari, G., Dollar, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV) 2017, Venice, Italy.10.1109/ICCV.2017.322 ↗
12. Enhancing CNN with Preprocessing Stage in Automatic Emotion Recognition10.1016/j.procs.2017.10.038 ↗
13. A Dual Convolution Network Using Dark Channel Prior for Image Smoke Classification10.1109/ACCESS.2019.2915599 ↗
14. Seebamrungsat, J., Praising, S., and Riyamongkol, P. (2014, January 26–27). Fire detection in the buildings using image processing. Proceedings of the 2014 Third ICT International Student Project Conference (ICT-ISPC) 2014, Bangkok, Thailand.10.1109/ICT-ISPC.2014.6923226 ↗
15. A semi-supervised Laplacian extreme learning machine and feature fusion with CNN for industrial superheat identification10.1016/j.neucom.2019.11.012 ↗
16. A convolutional neural network-based flame detection method in video sequence10.1007/s11760-018-1319-4 ↗
17. Cai, Y., Guo, Y., Li, Y., Li, H., and Liu, J. (2019, January 23–25). Fire Detection Method Based on Improved Deep Convolution Neural Network. Proceedings of the 2019 8th International Conference on Computing and Pattern Recognition 2019, Beijing, China.10.1145/3373509.3373570 ↗
18. Yang, Z., Shi, W., Huang, Z., Yin, Z., Yang, F., and Wang, M. (2018, January 8–11). Combining Gaussian Mixture Model and HSV Model with Deep Convolution Neural Network for Detecting Smoke in Videos. Proceedings of the 2018 IEEE 18th International Conference on Communication Technology (ICCT) 2018, Chongqing, China.10.1109/ICCT.2018.8599905 ↗
19. A Comparative Assessment of the Performances of Different Edge Detection Operator using Harris Corner Detection Method
20. Hassan, N., Ming, K.W., and Wah, C.K. (2020, January 26–29). A Comparative Study on HSV-based and Deep Learning-based Object Detection Algorithms for Pedestrian Traffic Light Signal Recognition. Proceedings of the 2020 3rd International Conference on Intelligent Autonomous Systems (ICoIAS) 2020, Singapore.10.1109/ICoIAS49312.2020.9081854 ↗
21. Harris, C., and Stephens, M. (September, January 31). A Combined Corner and Edge Detector. Proceedings of the Alvey Vision Conference, Manchester, UK.
22. Ye, Z., Pei, Y., and Shi, J. (2009, January 17–19). An Improved Algorithm for Harris Corner Detection. Proceedings of the 2009 2nd International Congress on Image and Signal Processing 2009, Tianjin, China.10.1109/CISP.2009.5304635 ↗
23. Zhang, J., Lian, Y., Jiao, C., Guo, D., and Liu, J. (2010, January 16–18). An Improved Harris Corner Distraction Method Based on B_Spline. Proceedings of the 2010 2nd IEEE International Conference on Information Management and Engineering, Chengdu, China.
24. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
25. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27–30). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016, Las Vegas, NV, USA.10.1109/CVPR.2016.308 ↗
26. Deep convolutional neural network Inception-v3 model for differential diagnosing of lymph node in cytological images: A pilot study10.21037/atm.2019.06.29 ↗
27. Girshick, R. (2015, January 7–13). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV) 2015, Santiago, Chile.10.1109/ICCV.2015.169 ↗
28. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
29. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11–14). SSD: Single Shot MultiBox Detector. Proceedings of the Computer Vision—ECCV 2016, Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
30. Golf swing classification with multiple deep convolutional neural networks10.1177/1550147718802186 ↗
31. Network anomaly detection using channel boosted and residual learning based deep convolutional neural network10.1016/j.asoc.2019.105612 ↗
32. Towards Accurate Segmentation of Retinal Vessels and the Optic Disc in Fundoscopic Images with Generative Adversarial Networks10.1007/s10278-018-0126-3 ↗