journal article·2023-10-21Open access

Fire Detection and Geo-Localization Using UAV’s Aerial Images and Yolo-Based Models

Kheireddine Choutri, Mohand Lagha, Souham Meshoul, Mohamed Batouche, Farah Bouzidi, Wided Charef

Applied Sciences· Volume 13· Issue 20

Abstract

The past decade has witnessed a growing demand for drone-based fire detection systems, driven by escalating concerns about wildfires exacerbated by climate change, as corroborated by environmental studies. However, deploying existing drone-based fire detection systems in real-world operational conditions poses practical challenges, notably the intricate and unstructured environments and the dynamic nature of UAV-mounted cameras, often leading to false alarms and inaccurate detections. In this paper, we describe a two-stage framework for fire detection and geo-localization. The key features of the proposed work included the compilation of a large dataset from several sources to capture various visual contexts related to fire scenes. The bounding boxes of the regions of interest were labeled using three target levels, namely fire, non-fire, and smoke. The second feature was the investigation of YOLO models to undertake the detection and localization tasks. YOLO-NAS was retained as the best performing model using the compiled dataset with an average mAP50 of 0.71 and an F1_score of 0.68. Additionally, a fire localization scheme based on stereo vision was introduced, and the hardware implementation was executed on a drone equipped with a Pixhawk microcontroller. The test results were very promising and showed the ability of the proposed approach to contribute to a comprehensive and effective fire detection system.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Fire Detection and Safety Systems · Video Surveillance and Tracking Methods · UAV Applications and Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Aeronautical Sciences Laboratory, Aeronautical and Spatial Studies Institute, Blida 1 University, Blida 0900, Algeria

Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia

Funding

Princess Nourah bint Abdulrahman University

References (42)

Show source-provided references
1. Choutri, K., Fadloun, S., Lagha, M., Bouzidi, F., and Charef, W. (2022, January 29–30). Forest Fire Detection Using IoT Enabled UAV And Computer Vision. Proceedings of the 2022 International Conference on Artificial Intelligence of Things (ICAIoT), Istanbul, Turkey.10.1109/ICAIoT57170.2022.10121881 ↗
2. Design of search and rescue system using autonomous Multi-UAVs10.3233/IDT-190138 ↗
3. A fully autonomous search and rescue system using quadrotor UAV10.12785/ijcds/100140 ↗
4. Khan, F., Xu, Z., Sun, J., Khan, F.M., Ahmed, A., and Zhao, Y. (2022). Recent advances in sensors for fire detection. Sensors, 22.10.3390/s22093310 ↗
5. An Infrared Image Stitching Method for Wind Turbine Blade Using UAV Flight Data and U-Net10.1109/JSEN.2023.3257824 ↗
6. Hao, K., and Wang, J. (2023, January 15). Design of FPGA-based TDLAS aircraft fire detection system. Proceedings of the Third International Conference on Sensors and Information Technology (ICSI 2023), Xiamen, China.10.1117/12.2678929 ↗
7. Active fire detection using a novel convolutional neural network based on Himawari-8 satellite images10.3389/fenvs.2022.794028 ↗
8. A review on forest fire detection
9. Zhang, L., Wang, M., Fu, Y., and Ding, Y. (2022). A Forest Fire Recognition Method Using UAV Images Based on Transfer Learning. Forests, 13.10.3390/f13070975 ↗
10. Partheepan, S., Sanati, F., and Hassan, J. (2023). Autonomous Unmanned Aerial Vehicles in Bushfire Management: Challenges and Opportunities. Drones, 7.10.3390/drones7010047 ↗
11. Ahmed, H., Bakr, M., Talib, M.A., Abbas, S., and Nasir, Q. (2022, January 16–17). Unmanned aerial vehicles (UAVs) and artificial intelligence (AI) in fire related disaster recovery: Analytical survey study. Proceedings of the 2022 International Conference on Business Analytics for Technology and Security (ICBATS), Dubai, United Arab Emirates.10.1109/ICBATS54253.2022.9759056 ↗
12. Chino, D.Y., Avalhais, L.P., Rodrigues, J.F., and Traina, A.J. (2015, January 26–29). Bowfire: Detection of fire in still images by integrating pixel color and texture analysis. Proceedings of the 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images, Salvador, Brazil.10.1109/SIBGRAPI.2015.19 ↗
13. Cazzolato, M.T., Avalhais, L., Chino, D., Ramos, J.S., de Souza, J.A., Rodrigues, J.F., and Traina, A. (2017, January 2–5). Fismo: A compilation of datasets from emergency situations for fire and smoke analysis. Proceedings of the Brazilian Symposium on Databases-SBBD. SBC Uberlândia, Minas Gerais, Brazil.
14. Aerial imagery pile burn detection using deep learning: The FLAME dataset10.1016/j.comnet.2021.108001 ↗
15. Novo, A., Fariñas-Álvarez, N., Martínez-Sánchez, J., González-Jorge, H., Fernández-Alonso, J.M., and Lorenzo, H. (2020). Mapping Forest Fire Risk—A Case Study in Galicia (Spain). Remote Sens., 12.10.3390/rs12223705 ↗
16. A review on early wildfire detection from unmanned aerial vehicles using deep learning-based computer vision algorithms10.1016/j.sigpro.2021.108309 ↗
17. Smokey comes of age: Unmanned aerial systems for fire management10.1002/fee.1299 ↗
18. Skeele, R.C., and Hollinger, G.A. (2016). Field and Service Robotics, Springer.
19. Beachly, E., Detweiler, C., Elbaum, S., Duncan, B., Hildebrandt, C., Twidwell, D., and Allen, C. (2018, January 1–5). Fire-aware planning of aerial trajectories and ignitions. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8593568 ↗
20. Early detection of forest fire using mixed learning techniques and UAV10.1155/2022/3170244 ↗
21. Weslya, U.J., Chaitanyab, R.V.S., Kumarc, P.L., Kumard, N.S., and Devie, B. (2022, January 22–23). A Detailed Investigation on Forest Monitoring System for Wildfire Using IoT. Proceedings of the First International Conference on Recent Developments in Electronics and Communication Systems (RDECS-2022), Surampalem, India.10.3233/ATDE221275 ↗
22. Deep learning and stereo vision-based detection of post-earthquake fire geolocation for smart cities within the scope of disaster management: Istanbul case10.1016/j.ijdrr.2023.103906 ↗
23. An accurate 3-D fire location method based on sub-pixel edge detection and non-parametric 545 stereo matching10.1016/j.measurement.2013.12.022 ↗
24. Tsai, P.F., Liao, C.H., and Yuan, S.M. (2022). Using deep learning with thermal imaging for human detection in heavy smoke scenarios. Sensors, 22.10.3390/s22145351 ↗
25. Study on water jet trajectory model of fire monitor based on simulation and experiment10.1007/s10694-018-0804-1 ↗
26. A multimodal 3D framework for fire characteristics estimation10.1088/1361-6501/aa9cf3 ↗
27. Robotic fire suppression through autonomous feedback control10.1007/s10694-016-0623-1 ↗
28. Monocular-vision-based method for online measurement of pose parameters of weld stud10.1016/j.measurement.2014.10.041 ↗
29. A survey on technologies for automatic forest fire monitoring, detection, and fighting using unmanned 556 aerial vehicles and remote sensing techniques10.1139/cjfr-2014-0347 ↗
30. An improved fire detection approach based on YOLO-v8 for smart cities10.1007/s00521-023-08809-1 ↗
31. Object detection using YOLO: Challenges, architectural successors, datasets and applications10.1007/s11042-022-13644-y ↗
32. Li, J., Xu, R., and Liu, Y. (2023). An Improved Forest Fire and Smoke Detection Model Based on YOLOv5. Forests, 14.10.3390/f14040833 ↗
33. Abdusalomov, A.B., Islam, B.M.S., Nasimov, R., Mukhiddinov, M., and Whangbo, T.K. (2023). An improved forest fire detection method based on the detectron2 model and a deep learning approach. Sensors, 23.10.3390/s23031512 ↗
34. Lu, K., Xu, R., Li, J., Lv, Y., Lin, H., and Liu, Y. (2022). A Vision-Based Detection and Spatial Localization Scheme for Forest Fire Inspection from UAV. Forests, 13.10.3390/f13030383 ↗
35. Real-time Forest fire detection framework based on artificial intelligence using color probability model and motion feature analysis10.3390/fire5010023 ↗
36. Unmanned Aerial Vehicle (UAV) based Forest Fire Detection and monitoring for reducing false alarms in forest-fires10.1016/j.comcom.2019.10.007 ↗
37. DeepFire: A Novel Dataset and Deep Transfer Learning Benchmark for Forest Fire Detection
38. Chopde, A., Magon, A., and Bhatkar, S. (2022, January 10–12). Forest Fire Detection and Prediction from Image Processing Using RCNN. Proceedings of the 7th World Congress on Civil, Structural, and Environmental Engineering, Virtual.10.11159/iceptp22.204 ↗
39. Jocher, G., Chaurasia, A., and Qiu, J. (2023, June 01). Ultralytics YOLOv8 2023; 2023. Available online: https://github.com/ultralytics/ultralytics.
40. Aharon, S., Dupont, L., Masad, O., Yurkova, K., Fridman, L., Khvedchenya, E., Rubin, R., Bagrov, N., and Tymchenko, B. (2021). Super-Gradients. GitHub Repos.
41. Mathwork (2021, May 01). Computer Vision Toolbox. Available online: https://www.mathworks.com/products/computer-vision.html.
42. Mathwork (2021, May 01). Image Processing Toolbox. Available online: https://www.mathworks.com/products/image.html.