STEAM: Spatial Trajectory Enhanced Attention Mechanism for Abnormal UAV Trajectory Detection
Source abstract
Abstract
Accurate unmanned aerial vehicle (UAV) trajectory tracking is crucial for the successful execution of UAV missions. Traditional global positioning system (GPS) methods face limitations in complex environments, and visual observation becomes challenging with distance and in low-light conditions. To address this challenge, we propose a comprehensive framework for UAV trajectory verification, integrating a range-based ultra-wideband (UWB) positioning system and advanced image processing technologies. Our key contribution is the development of the Spatial Trajectory Enhanced Attention Mechanism (STEAM), a novel attention module specifically designed for analyzing and classifying UAV trajectory patterns. This system enables real-time UAV trajectory tracking and classification, facilitating swift and accurate assessment of adherence to predefined optimal trajectories. Another major contribution of our work is the integration of a UWB system for precise UAV location tracking, complemented by our advanced image processing approach that includes a deep neural network (DNN) for interpolating missing data from images, thereby significantly enhancing the model’s ability to detect abnormal maneuvers. Our experimental results demonstrate the effectiveness of the proposed framework in UAV trajectory tracking, showcasing its robust performance irrespective of raw data quality. Furthermore, we validate the framework’s performance using a lightweight learning model, emphasizing both its computational efficiency and exceptional classification accuracy.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotic Path Planning Algorithms · Robotics and Sensor-Based Localization · Video Surveillance and Tracking Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electrical Engineering, Korea University, Seoul 02841, Republic of Korea
Funding
MSIT (Ministry of Science and ICT) · Human Resources Program in Energy Technology of the Korea Institute of Energy Technology Evaluation and Planning (KETEP)
References (51)
Show source-provided references
1. Path planning techniques for unmanned aerial vehicles: A review, solutions, and challenges10.1016/j.comcom.2019.10.014 ↗
2. Cabreira, T.M., Brisolara, L.B., and Paulo, R.F.J. (2019). Survey on coverage path planning with unmanned aerial vehicles. Drones, 3.10.3390/drones3010004 ↗
3. Shivgan, R., and Dong, Z. (2020, January 11–14). Energy-efficient drone coverage path planning using genetic algorithm. Proceedings of the 2020 IEEE 21st International Conference on High Performance Switching and Routing (HPSR), Newark, NJ, USA.10.1109/HPSR48589.2020.9098989 ↗
4. Multi-objective drone path planning for search and rescue with quality-of-service requirements10.1007/s10514-020-09926-9 ↗
5. Yoo, T., Lee, S., Yoo, K., and Kim, H. (2023). Reinforcement Learning Based Topology Control for UAV Networks. Sensors, 23.10.3390/s23020921 ↗
6. Park, C., Lee, S., Joo, H., and Kim, H. (2023). Empowering Adaptive Geolocation-Based Routing for UAV Networks with Reinforcement Learning. Drones, 7.10.3390/drones7060387 ↗
7. Configuring RTK-GPS architecture for system redundancy in multi-drone operations10.1109/ACCESS.2020.2989276 ↗
8. Universal path planning for an indoor drone10.1016/j.autcon.2018.07.025 ↗
9. Kim, H.T., and Kim, H. (2020, January 7–11). Precise localization of a UAV with single vision camera and deep learning. Proceedings of the GLOBECOM 2020 IEEE Global Communications Conference, Taipei, Taiwan.10.1109/GLOBECOM42002.2020.9322358 ↗
10. Ibrahim, N.A., Zakaria, M.Y., and Kamal, A. (2023, January 23–27). Development of a Flight Test Data Analyzer for Pixhawk Autopilots. Proceedings of the AIAA SCITECH 2023 Forum, National Harbor, MD, USA.10.2514/6.2023-0482 ↗
11. Drone positioning system using UWB sensing and out-of-band control10.1109/JSEN.2021.3127233 ↗
12. Acharya, T., and Ray, A.K. (2005). Image Processing: Principles and Applications, John Wiley & Sons.10.1002/0471745790 ↗
13. Park, S., and Kim, H. (2022). Dagmap: Multi-drone slam via a dag-based distributed ledger. Drones, 6.10.3390/drones6020034 ↗
14. Chmaj, G., and Selvaraj, H. (2015, January 7–10). Distributed processing applications for UAV/drones: A survey. Proceedings of the Progress in Systems Engineering: Proceedings of the Twenty-Third International Conference on Systems Engineering, Indianapolis, IN, USA.10.1007/978-3-319-08422-0_66 ↗
15. Tsouros, D.C., Bibi, S., and Sarigiannidis, P.G. (2019). A review on UAV-based applications for precision agriculture. Information, 10.10.3390/info10110349 ↗
16. Application research of image recognition technology based on CNN in image location of environmental monitoring UAV10.1186/s13640-018-0391-6 ↗
17. Applications of drone in disaster management: A scoping review10.1016/j.scijus.2021.11.002 ↗
18. Trajectory and image-based detection and identification of UAV10.1007/s00371-020-01937-y ↗
19. Failure analysis for an unmanned aerial vehicle using safe path planning
20. Path planning of mobile landmarks for localization in wireless sensor networks10.1016/j.comcom.2007.05.048 ↗
21. Huang, R., and Zaruba, G.V. (2007, January 19–23). Static path planning for mobile beacons to localize sensor networks. Proceedings of the Fifth Annual IEEE International Conference on Pervasive Computing and Communications Workshops (PerComW’07), White Plains, NY, USA.10.1109/PERCOMW.2007.109 ↗
22. Superior path planning mechanism for mobile beacon-assisted localization in wireless sensor networks10.1109/JSEN.2014.2322958 ↗
23. Drone path planning for secure positioning and secure position verification10.1109/TMC.2016.2627552 ↗
24. Classification of manifold learning based flight fingerprints of UAVs in air traffic10.1109/TITS.2023.3237159 ↗
25. A hybrid approach for UAV flight data estimation and prediction based on flight mode recognition10.1016/j.microrel.2018.03.032 ↗
26. Aksoy, M., Ozdemir, O., Guner, G., Baspinar, B., and Koyuncu, E. (2021, January 23–27). Flight trajectory pattern generalization and abnormal flight detection with generative adversarial network. Proceedings of the AIAA Scitech 2021 Forum, National Harbor, MD, USA.10.2514/6.2021-0775 ↗
27. An optimal curvature smoothing method and the associated real-time interpolation for the trajectory generation of flying robots10.1016/j.robot.2019.02.004 ↗
28. Hybrid methodology based on computational vision and sensor fusion for assisting autonomous UAV on offshore messenger cable transfer operation10.1017/S026357472100196X ↗
29. Zeng, W., Xu, Z., Cai, Z., Chu, X., and Lu, X. (2021). Aircraft trajectory clustering in terminal airspace based on deep autoencoder and gaussian mixture model. Aerospace, 8.10.3390/aerospace8090266 ↗
30. Vladimir, G., Yury, M., and Natalya, K. (2022). Neural Computing and Applications, Springer.
31. Mcfadyen, A., O’Flynn, M., Martin, T., and Campbell, D. (2016, January 5–12). Aircraft trajectory clustering techniques using circular statistics. Proceedings of the 2016 IEEE Aerospace Conference, Big Sky, MT, USA.10.1109/AERO.2016.7500601 ↗
32. Gingrass, C.J. (2020). Classifying ADS-B Trajectory Shapes Using a Dense Feed-Forward Neural Network. [Ph.D. Thesis, Naval Postgraduate School].
33. Math-data integrated prediction model for ship maneuvering motion10.1016/j.oceaneng.2023.115255 ↗
34. SeaBil: Self-attention-weighted ultrashort-term deep learning prediction of ship maneuvering motion10.1016/j.oceaneng.2023.115890 ↗
35. Jun, M., and D’Andrea, R. (2003). Cooperative Control: Models, Applications and Algorithms, Springer.
36. Path-planning for unmanned aerial vehicles with environment complexity considerations: A survey10.1145/3570723 ↗
37. Liu, G., Reda, F.A., Shih, K.J., Wang, T.C., Tao, A., and Catanzaro, B. (2018, January 8–14). Image inpainting for irregular holes using partial convolutions. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01252-6_6 ↗
38. Partial convolutional LSTM for spatiotemporal prediction of incomplete data10.1109/ACCESS.2020.3022774 ↗
39. Partial convolution for padding, inpainting, and image synthesis
40. Xing, D., Hou, J., Huang, C., and Zhang, W. (2022). Spatiotemporal Reconstruction of MODIS Normalized Difference Snow Index Products Using U-Net with Partial Convolutions. Remote Sens., 14.10.3390/rs14081795 ↗
41. A review on the attention mechanism of deep learning10.1016/j.neucom.2021.03.091 ↗
42. Attention mechanisms in computer vision: A survey10.1007/s41095-022-0271-y ↗
43. Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv.
44. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 10). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
45. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
46. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16 × 16 words: Transformers for image recognition at scale. arXiv.
47. Hafiz, A.M., Parah, S.A., and Bhat, R.U.A. (2021). Attention mechanisms and deep learning for machine vision: A survey of the state of the art. arXiv.10.21203/rs.3.rs-510910/v1 ↗
48. Liu, G., Shih, K.J., Wang, T.C., Reda, F.A., Sapra, K., Yu, Z., Tao, A., and Catanzaro, B. (2018). Partial convolution based padding. arXiv.
49. Zhang, Z., Wu, Y., Zhang, J., and Kwok, J. (2023, January 7–14). Efficient channel attention for deep convolutional neural networks. Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA.
50. RF-based drone detection and identification using deep learning approaches: An initiative towards a large open source drone database10.1016/j.future.2019.05.007 ↗
51. Garg, I., and Roy, K. (2023, January 18–23). Samples With Low Loss Curvature Improve Data Efficiency. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01943 ↗