journal article·2021-01-01Open access

A Survey on Robotic Technologies for Forest Firefighting: Applying Drone Swarms to Improve Firefighters’ Efficiency and Safety

Juan Jesús Roldán-Gómez, Eduardo González-Gironda, Antonio Barrientos

Applied Sciences· Volume 11· Issue 1

Abstract

Forest firefighting missions encompass multiple tasks related to prevention, surveillance, and extinguishing. This work presents a complete survey of firefighters on the current problems in their work and the potential technological solutions. Additionally, it reviews the efforts performed by the academy and industry to apply different types of robots in the context of firefighting missions. Finally, all this information is used to propose a concept of operation for the comprehensive application of drone swarms in firefighting. The proposed system is a fleet of quadcopters that individually are only able to visit waypoints and use payloads, but collectively can perform tasks of surveillance, mapping, monitoring, etc. Three operator roles are defined, each one with different access to information and functions in the mission: mission commander, team leaders, and team members. These operators take advantage of virtual and augmented reality interfaces to intuitively get the information of the scenario and, in the case of the mission commander, control the drone swarm.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Fire effects on ecosystems · Fire Detection and Safety Systems · UAV Applications and Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Departamento de Ingeniería Informática, Escuela Politécnica Superior, Universidad Autónoma de Madrid, Francisco Tomás y Valiente, 11, 28049 Madrid, Spain

Centro de Automática y Robótica (UPM-CSIC), Universidad Politécnica de Madrid, José Gutiérrez Abascal, 2, 28006 Madrid, Spain

References (60)

Show source-provided references
1. Brushlinsky, N., Ahrens, M., Sokolov, S., and Wagner, P. (2018). World Fire Statistics, Center of Fire Statistics. Technical Report 23.
2. Mota, B., Pereira, J., Oom, D., Vasconcelos, M., and Schultz, M. (2006). Screening the ESA ATSR-2 World Fire Atlas (1997-2002). Atmos. Chem. Phys.10.5194/acpd-5-4641-2005 ↗
3. First study of Sentinel-3 SLSTR active fire detection and FRP retrieval: Night-time algorithm enhancements and global intercomparison to MODIS and VIIRS AF products10.1016/j.rse.2020.111947 ↗
4. The Global Fire Atlas of individual fire size, duration, speed and direction10.5194/essd-11-529-2019 ↗
5. Los Incendios Forestales en España: Avance Informativo 2019 (2020, December 31). Technical report, Área de Defensa contra Incendios Forestales, Ministerio para la Transición Ecológica y el Reto Demográfico, Gobierno de España. Available online: https://www.mapa.gob.es/es/desarrollo-rural/estadisticas/avance_1_enero_31_diciembre_2019_tcm30-537398.pdf.
6. Los Incendios Forestales en España: Decenio 2006–2015 (2020, December 31). Technical report, Área de Defensa contra Incendios Forestales, Ministerio de Agricultura, Pesca y Alimentación, Gobierno de España. Available online: https://www.mapa.gob.es/es/desarrollo-rural/estadisticas/incendios-decenio-2006-2015_tcm30-511095.pdf.
7. Muñoz, R.V. (2009). La Defensa Contra Incendios Forestales: Fundamentos y Experiencias, McGraw-Hill Interamericana de España.
8. Russell, M.T. (2016). Fire Chief Perception of Unmanned Aircraft Systems: A Diffusion Study, New Jersey City University.
9. MacSween, S. (2003, January 15–18). A public opinion survey-unmanned aerial vehicles for cargo, commercial, and passenger transportation. Proceedings of the 2nd AIAA“ Unmanned Unlimited” Conference and Workshop & Exhibit, San Diego, CA, USA.10.2514/6.2003-6519 ↗
10. Public acceptance of drones: Knowledge, attitudes, and practice10.1016/j.techsoc.2019.101180 ↗
11. Ghamry, K.A., Kamel, M.A., and Zhang, Y. (2017, January 13–16). Multiple UAVs in forest fire fighting mission using particle swarm optimization. Proceedings of the 2017 International Conference on Unmanned Aircraft Systems (ICUAS), Miami, FL, USA.10.1109/ICUAS.2017.7991527 ↗
12. Roldán, J.J., del Cerro, J., Garzón-Ramos, D., Garcia-Aunon, P., Garzón, M., de León, J., and Barrientos, A. (2018). Robots in agriculture: State of art and practical experiences. Serv. Robot.10.5772/intechopen.69874 ↗
13. Automated crop plant counting from very high-resolution aerial imagery10.1007/s11119-020-09725-3 ↗
14. Anders, N., Valente, J., Masselink, R., and Keesstra, S. (2019). Comparing Filtering Techniques for Removing Vegetation from UAV-Based Photogrammetric Point Clouds. Drones, 3.10.3390/drones3030061 ↗
15. Zhang, C., Valente, J., Kooistra, L., Guo, L., and Wang, W. (2019). Opportunities of uavs in orchard management. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci.10.5194/isprs-archives-XLII-2-W13-673-2019 ↗
16. Aerial remote sensing in agriculture: A practical approach to area coverage and path planning for fleets of mini aerial robots10.1002/rob.20403 ↗
17. Bergerman, M., Billingsley, J., Reid, J., and van Henten, E. (2016). Robotics in agriculture and forestry. Springer Handbook of Robotics, Springer.10.1007/978-3-319-32552-1_56 ↗
18. Aguiar, A.S., dos Santos, F.N., Cunha, J.B., Sobreira, H., and Sousa, A.J. (2020). Localization and Mapping for Robots in Agriculture and Forestry: A Survey. Robotics, 9.10.3390/robotics9040097 ↗
19. Couceiro, M.S., Portugal, D., Ferreira, J.F., and Rocha, R.P. (2019, January 14–16). SEMFIRE: Towards a new generation of forestry maintenance multi-robot systems. Proceedings of the 2019 IEEE/SICE International Symposium on System Integration (SII), Paris, France.10.1109/SII.2019.8700403 ↗
20. Yuan, C., Liu, Z., and Zhang, Y. (2017, January 13–16). Fire detection using infrared images for UAV-based forest fire surveillance. Proceedings of the 2017 International Conference on Unmanned Aircraft Systems (ICUAS), Miami, FL, USA.10.1109/ICUAS.2017.7991306 ↗
21. Using wireless sensor networks for reliable forest fires detection10.1016/j.procs.2013.06.104 ↗
22. Yuan, C., Liu, Z., and Zhang, Y. (2016, January 7–10). Vision-based forest fire detection in aerial images for firefighting using UAVs. Proceedings of the 2016 International Conference on Unmanned Aircraft Systems (ICUAS), Arlington, VA, USA.10.1109/ICUAS.2016.7502546 ↗
23. Yuan, C., Liu, Z., and Zhang, Y. (2015, January 9–12). UAV-based forest fire detection and tracking using image processing techniques. Proceedings of the 2015 International Conference on Unmanned Aircraft Systems (ICUAS), Denver, CO, USA.10.1109/ICUAS.2015.7152345 ↗
24. Allauddin, M.S., Kiran, G.S., Kiran, G.R., Srinivas, G., Mouli, G.U.R., and Prasad, P.V. (August, January 28). Development of a Surveillance System for Forest Fire Detection and Monitoring using Drones. Proceedings of the IGARSS 2019—2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.10.1109/IGARSS.2019.8900436 ↗
25. Barmpoutis, P., Papaioannou, P., Dimitropoulos, K., and Grammalidis, N. (2020). A Review on Early Forest Fire Detection Systems Using Optical Remote Sensing. Sensors, 20.10.3390/s20226442 ↗
26. Dang-Ngoc, H., and Nguyen-Trung, H. (2019, January 17–19). Aerial Forest Fire Surveillance-Evaluation of Forest Fire Detection Model using Aerial Videos. Proceedings of the 2019 International Conference on Advanced Technologies for Communications (ATC), Hanoi, Vietnam.10.1109/ATC.2019.8924547 ↗
27. Barmpoutis, P., Stathaki, T., Dimitropoulos, K., and Grammalidis, N. (2020). Early fire detection based on aerial 360-degree sensors, deep convolution neural networks and exploitation of fire dynamic textures. Remote Sens., 12.10.3390/rs12193177 ↗
28. Automated location of active fire perimeters in aerial infrared imaging using unsupervised edge detectors10.1071/WF17093 ↗
29. Multisensor network system for wildfire detection using infrared image processing10.1155/2013/402196 ↗
30. Hyperspectral remote sensing of fire: State-of-the-art and future perspectives10.1016/j.rse.2018.06.020 ↗
31. Carvajal-Ramírez, F., Marques da Silva, J.R., Agüera-Vega, F., Martínez-Carricondo, P., Serrano, J., and Moral, F.J. (2019). Evaluation of fire severity indices based on pre-and post-fire multispectral imagery sensed from UAV. Remote Sens., 11.10.3390/rs11090993 ↗
32. Fire detection using autonomous aerial vehicles with infrared and visual cameras10.3182/20050703-6-CZ-1902.01380 ↗
33. Fonollosa, J., Solórzano, A., and Marco, S. (2018). Chemical sensor systems and associated algorithms for fire detection: A review. Sensors, 18.10.3390/s18020553 ↗
34. Forest fire detection solution based on UAV aerial data10.14257/ijsh.2015.9.8.25 ↗
35. Kinaneva, D., Hristov, G., Raychev, J., and Zahariev, P. (2019, January 20–24). Early forest fire detection using drones and artificial intelligence. Proceedings of the 2019 42nd International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia.10.23919/MIPRO.2019.8756696 ↗
36. Jiao, Z., Zhang, Y., Xin, J., Mu, L., Yi, Y., Liu, H., and Liu, D. (2019, January 23–27). A Deep Learning Based Forest Fire Detection Approach Using UAV and YOLOv3. Proceedings of the 2019 1st International Conference on Industrial Artificial Intelligence (IAI), Shenyang, China.10.1109/ICIAI.2019.8850815 ↗
37. Burke, C., Wich, S., Kusin, K., McAree, O., Harrison, M.E., Ripoll, B., Ermiasi, Y., Mulero-Pázmány, M., and Longmore, S. (2019). Thermal-Drones as a Safe and Reliable Method for Detecting Subterranean Peat Fires. Drones, 3.10.3390/drones3010023 ↗
38. Ghamry, K.A., Kamel, M.A., and Zhang, Y. (2016, January 7–10). Cooperative forest monitoring and fire detection using a team of UAVs-UGVs. Proceedings of the 2016 International Conference on Unmanned Aircraft Systems (ICUAS), Arlington, VA, USA.10.1109/ICUAS.2016.7502585 ↗
39. Unmanned Aerial Vehicle (UAV) based Forest Fire Detection and monitoring for reducing false alarms in forest-fires10.1016/j.comcom.2019.10.007 ↗
40. Qin, H., Cui, J.Q., Li, J., Bi, Y., Lan, M., Shan, M., Liu, W., Wang, K., Lin, F., and Zhang, Y. (2016, January 1–3). Design and implementation of an unmanned aerial vehicle for autonomous firefighting missions. Proceedings of the 2016 12th IEEE International Conference on Control and Automation (ICCA), Kathmandu, Nepal.10.1109/ICCA.2016.7505253 ↗
41. Aerial hose type robot by water jet for fire fighting10.1109/LRA.2018.2792701 ↗
42. Ogawa, S., Kudo, S., Koide, M., Torikai, H., and Iwatani, Y. (2014, January 5–10). Development and control of an aerial extinguisher with an inert gas capsule. Proceedings of the 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014), Bali, Indonesia.10.1109/ROBIO.2014.7090516 ↗
43. Aydin, B., Selvi, E., Tao, J., and Starek, M.J. (2019). Use of fire-extinguishing balls for a conceptual system of drone-assisted wildfire fighting. Drones, 3.10.3390/drones3010017 ↗
44. Fire extinguishing system for high-rise buildings and rugged mountainous terrains utilizing quadrotor unmanned aerial vehicle10.5815/ijigsp.2018.01.03 ↗
45. The design of a rotary-wing unmanned aerial vehicles–payload drop mechanism for fire-fighting services using fire-extinguishing balls10.1007/s42452-019-1322-6 ↗
46. Unmanned Fire Extinguisher Using Quadcopter
47. Sherstjuk, V., Zharikova, M., and Sokol, I. (2019, January 22–24). Forest Fire Fighting Using Heterogeneous Ensemble of Unmanned Aerial Vehicles. Proceedings of the 2019 IEEE 5th International Conference Actual Problems of Unmanned Aerial Vehicles Developments (APUAVD), Kiev, Ukraine.10.1109/APUAVD47061.2019.8943826 ↗
48. Islam, S., and Razi, A. (2019, January 20–22). A path planning algorithm for collective monitoring using autonomous drones. Proceedings of the 2019 53rd Annual Conference on Information Sciences and Systems (CISS), Baltimore, MD, USA.10.1109/CISS.2019.8693023 ↗
49. Self-organising swarms of firefighting drones: Harnessing the power of collective intelligence in decentralised multi-robot systems10.1016/j.jocs.2019.04.009 ↗
50. Haksar, R.N., and Schwager, M. (2018, January 1–5). Distributed deep reinforcement learning for fighting forest fires with a network of aerial robots. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8593539 ↗
51. Seraj, E., Silva, A., and Gombolay, M. (2019). Safe Coordination of Human-Robot Firefighting Teams. arXiv.
52. Sherstjuk, V., Zharikova, M., and Sokol, I. (2018, January 24–26). Forest fire-fighting monitoring system based on uav team and remote sensing. Proceedings of the 2018 IEEE 38th International Conference on Electronics and Nanotechnology (ELNANO), Kiev, Ukraine.10.1109/ELNANO.2018.8477527 ↗
53. Monitoring traffic in future cities with aerial swarms: Developing and optimizing a behavior-based surveillance algorithm10.1016/j.cogsys.2018.10.031 ↗
54. Al-Turjman, F. (2019). A novel approach for drones positioning in mission critical applications. Trans. Emerg. Telecommun. Technol., e3603.10.1002/ett.3603 ↗
55. Wang, L., Sanchez-Matilla, R., and Cavallaro, A. (2018, January 1–5). Tracking a moving sound source from a multi-rotor drone. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8594483 ↗
56. Garcia-Aunon, P., and Barrientos Cruz, A. (2018). Comparison of heuristic algorithms in discrete search and surveillance tasks using aerial swarms. Appl. Sci., 8.10.3390/app8050711 ↗
57. Roldán-Gómez, J.J., Garcia-Aunon, P., Mazariegos, P., and Barrientos, A. (2020). SwarmCity project: Monitoring traffic, pedestrians, climate, and pollution with an aerial robotic swarm. Pers. Ubiquitous Comput., 1–17.10.1007/s00779-020-01504-1 ↗
58. Roldán, J.J., del Cerro, J., and Barrientos, A. (2015, January 16–19). A proposal of methodology for multi-UAV mission modeling. Proceedings of the 2015 23rd Mediterranean Conference on Control and Automation (MED), Torremolinos, Spain.10.1109/MED.2015.7158721 ↗
59. Bringing Adaptive and Immersive Interfaces to Real-World Multi-Robot Scenarios: Application to Surveillance and Intervention in Infrastructures10.1109/ACCESS.2019.2924938 ↗
60. Application of immersive technologies and natural language to hyper-redundant robot teleoperation