Unsupervised Binary Classifier-Based Object Detection Algorithm with Integrated Background Subtraction Suitable for Use with Aerial Imagery
Source abstract
Abstract
This research presents the development of a novel object detection algorithm designed to identify humans in natural outdoor environments using minimal computational resources. The proposed system, SARGAS, combines a custom convolutional neural network (CNN) classifier with MOG2 background subtraction and partial affine transformations for camera stabilization. A secondary CNN refines detections and reduces false positives. Unlike conventional supervised models, SARGAS is trained in a partially unsupervised manner, learning to recognize feature patterns without requiring labeled data. The algorithm achieved a recall of 93%, demonstrating strong detection capability even under challenging conditions. However, the overall accuracy reached 65%, due to a higher rate of false positives—an expected trade-off when maximizing recall. This bias is intentional, as missing a human target in search and rescue applications carries a higher cost than producing additional false detections. While supervised models, such as YOLOv5, perform well on data resembling their training sets, they exhibit significant performance degradation on previously unseen footage. In contrast, SARGAS generalizes more effectively, making it a promising candidate for real-world deployment in environments where labeled training data is limited or unavailable. The results establish a solid foundation for further improvements and suggest that unsupervised CNN-based approaches hold strong potential in object detection tasks.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Robotics and Sensor-Based Localization · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Aerospace Data Center, Antanas Gustaitis Aviation Institute, Vilnius Gediminas Technical University, 08217 Vilnius, Lithuania
References (46)
Show source-provided references
1. A study on rescuer drowning and multiple drowning incidents10.1016/j.jsr.2012.05.001 ↗
2. New Light on the Survivors of the Vergulde Draak, a VOC Ship Wrecked on the Australian Coast (1656)
3. The potential use of unmanned aircraft systems (drones) in mountain search and rescue operations10.1016/j.ajem.2017.09.025 ↗
4. Zhang, R., Li, H., Duan, K., You, S., Liu, K., Wang, F., and Hu, Y. (2020). Automatic detection of earthquake-damaged buildings by integrating UAV oblique photography and infrared thermal imaging. Remote Sens., 12.10.3390/rs12162621 ↗
5. Yalcin, E., Ciftcioglu, G.A., and Guzel, B.H. (2023). Guzel Human Factors Analysis by Classifying Chemical Accidents into Operations. Sustainability, 15.10.3390/su15108129 ↗
6. Waskito, D.H., Bowo, L.P., Kurnia, S.H.M., Kurniawan, I., Nugroho, S., Irawati, N., Mardiana, T.S. (2024). Analysing the Impact of Human Error on the Severity of Truck Accidents through HFACS and Bayesian Network Models. Safety, 10.10.3390/safety10010008 ↗
7. Kasyk, L., Wolnowska, A.E., Pleskacz, K., and Kapuściński, T. (2023). Kapuściński The Analysis of Social and Situational Systems as Components of Human Errors Resulting in Navigational Accidents. Appl. Sci., 13.10.3390/app13116780 ↗
8. Jalehi, M.K., and Albaker, B.M. (2023). Highly accurate multiclass classification of respiratory system diseases from chest radiography images using deep transfer learning technique. Biomed. Signal Process. Control, 84.10.1016/j.bspc.2023.104745 ↗
9. Huda, N., and Ku-Mahamud, K.R. (2025). CNN-Based Image Segmentation Approach in Brain Tumor Classification: A Review. Eng. Proc., 84.10.3390/engproc2025084066 ↗
10. Hwang, S., Park, J., Kim, N., Choi, Y., Kweon, I.S., and Korea Advanced Institute of Science and Technology (KAIST) (2023, November 15). Multispectral Pedestrian Detection: Benchmark Dataset and Baseline. Available online: http://rcv.kaist.ac.kr/index.php?mid=rcv_publications&document_srl=5203.
11. Autonomous power line detection and tracking system using UAVs10.1016/j.micpro.2022.104609 ↗
12. Tatum, M.C., and Liu, J. (2017). Unmanned Aircraft System Applications in Construction. Procedia Engineering, Elsevier Ltd.10.1016/j.proeng.2017.07.187 ↗
13. Khan, M.B., Tamkin, S., Ara, J., Alam, M., and Bhuiyan, H. (2025). CropsDisNet: An AI-Based Platform for Disease Detection and Advancing On-Farm Privacy Solutions. Data, 10.10.3390/data10020025 ↗
14. Hui, L., Ibrahim, A., and Hindi, R. (2025). Computer Vision-Based Concrete Crack Identification Using MobileNetV2 Neural Network and Adaptive Thresholding. Infrastructures, 10.10.3390/infrastructures10020042 ↗
15. Mitchell, T.M. (1997). Machine Learning, McGraw-Hill, Inc.. [1st ed.].
16. Alpaydin, E. (2004). Introduction to Machine Learning (Adaptive Computation and Machine Learning), The MIT Press.
17. Heuristic Problem Solving: The Next Advance in Operations Research10.1287/opre.6.1.1 ↗
18. Heaton, J. (2016). Ian Goodfellow, Yoshua Bengio, and Aaron Courville: Deep learning. Genet Program Evolvable Mach, The MIT Press.10.1007/s10710-017-9314-z ↗
19. Krizhevsky, A., Sutskever, I., and Hinton, G. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Neural Inf. Process. Syst., 25.
20. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A., and Liu, W. (2015, January 7–12). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
21. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
22. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
23. Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv, Available online: https://api.semanticscholar.org/CorpusID:14124313.
24. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
25. Girshick, R. (2015, January 7–13). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.169 ↗
26. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
27. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
28. Leibe, B., Matas, J., Sebe, N., and Welling, M. (2016, January 11–14). SSD: Single Shot MultiBox Detector. Proceedings of the Computer Vision—ECCV 2016, Amsterdam, The Netherlands.10.1007/978-3-319-46487-9 ↗
29. Chen, Y., Li, L., Li, W., Guo, Q., Du, Z., and Xu, Z. (2024). Chapter 1—Introduction. AI Computing Systems, Morgan Kaufmann.10.1016/B978-0-32-395399-3.00007-X ↗
30. Wang, X., Girdhar, R., Yu, S.X., and Misra, I. (2023). Cut and learn for unsupervised object detection and instance segmentation. arXiv.10.1109/CVPR52729.2023.00305 ↗
31. Siméoni, O., Puy, G., Vo, H.V., Roburin, S., Gidaris, S., Bursuc, A., Pérez, P., Marlet, R., and Ponce, J. (2021). Localizing objects with self-supervised transformers and no labels. arXiv.10.5244/C.35.365 ↗
32. Caron, M., Touvron, H., Misra, I., Jégou, H., Mairal, J., Bojanowski, P., and Joulin, A. (2021). Emerging properties in self-supervised vision transformers. arXiv.10.1109/ICCV48922.2021.00951 ↗
33. Dual-frequency lidar for compressed sensing 3D imaging based on all-phase fast Fourier transform10.47852/bonviewJOPR32021565 ↗
34. Wang, H., Zhang, G., Cao, H., Hu, K., Wang, Q., Deng, Y., Gao, J., and Tang, Y. (J. Field Robot., 2025). Geometry-aware 3D point cloud learning for precise cutting-point detection in unstructured field environments, J. Field Robot., early view.10.1002/rob.22567 ↗
35. Zhang, Y., Yin, Y., and Shao, Z. (2023). Shao An Enhanced Target Detection Algorithm for Maritime Search and Rescue Based on Aerial Images. Remote Sens., 15.10.3390/rs15194818 ↗
36. Bejiga, M.B., Zeggada, A., Nouffidj, A., and Melgani, F. (2017). A convolutional neural network approach for assisting avalanche search and rescue operations with UAV imagery. Remote Sens., 9.10.3390/rs9020100 ↗
37. Gotovac, S., Zelenika, D., Marušić, Ž., and Božić-Štulić, D. (2020). Visual-based person detection for search-and-rescue with uas: Humans vs. machine learning algorithm. Remote Sens., 12.10.3390/rs12203295 ↗
38. On the Analysis of Accumulative Difference Pictures from Image Sequences of Real World Scenes10.1109/TPAMI.1979.4766907 ↗
39. Pfinder: Real-time tracking of the human body10.1109/34.598236 ↗
40. Stauffer, C., and Grimson, W. (1999, January 23–25). Grimson, Adaptive background mixture models for real-time tracking. Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), Fort Collins, CO, USA.
41. Determining optical flow10.1016/0004-3702(81)90024-2 ↗
42. Lucas, B.D., and Kanade, T. (1981., January 24–28). An Iterative Image Registration Technique with an Application to Stereo Vision. Proceedings of the International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada. Available online: https://api.semanticscholar.org/CorpusID:2121536.
43. Broyles, D., Hayner, C., and Leung, K. (2022, January 23–27). WiSARD: A Labeled Visual and Thermal Image Dataset for Wilderness Search and Rescue. Proceedings of the 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Kyoto, Japan.10.1109/IROS47612.2022.9981298 ↗
44. Online real-time pedestrian tracking from medium altitude aerial footage with camera motion cancellation10.1016/j.cviu.2022.103386 ↗
45. A genetic algorithm for optical flow estimation10.1016/j.imavis.2006.01.021 ↗
46. Ding, J., Zhang, Z., Yu, X., Zhao, X., and Yan, Z. (2023). A Novel Moving Object Detection Algorithm Based on Robust Image Feature Threshold Segmentation with Improved Optical Flow Estimation. Appl. Sci., 13.10.3390/app13084854 ↗