journal article·2022Open access

Methods and Means for Small Dynamic Objects Recognition and Tracking

Dmytro Kushnir

Computers, Materials & Continua· Volume 73· Issue 2

Abstract

A literature analysis has shown that object search, recognition, and tracking systems are becoming increasingly popular. However, such systems do not achieve high practical results in analyzing small moving living objects ranging from 8 to 14 mm. This article examines methods and tools for recognizing and tracking the class of small moving objects, such as ants. To fulfill those aims, a customized You Only Look Once Ants Recognition (YOLO_AR) Convolutional Neural Network (CNN) has been trained to recognize Messor Structor ants in the laboratory using the LabelImg object marker tool. The proposed model is an extension of the You Only Look Once v4 (Yolov4) 512 × 512 model with an additional Self Regularized Non–Monotonic (Mish) activation function. Additionally, the scalable solution for continuous object recognizing and tracking was implemented. This solution is based on the OpenDatacam system, with extended Object Tracking modules that allow for tracking and counting objects that have crossed the custom boundary line. During the study, the methods of the alignment algorithm for finding the trajectory of moving objects were modified. I discovered that the Hungarian algorithm showed better results in tracking small objects than the K–D dimensional tree (k-d tree) matching algorithm used in OpenDataCam. Remarkably, such an algorithm showed better results with the implemented YOLO_AR model due to the lack of False Positives (FP). Therefore, I provided a new tracker module with a Hungarian matching algorithm verified on the Multiple Object Tracking (MOT) benchmark. Furthermore, additional customization parameters for object recognition and tracking results parsing and filtering were added, like boundary angle threshold (BAT) and past frames trajectory prediction (PFTP). Experimental tests confirmed the results of the study on a mobile device. During the experiment, parameters such as the quality of recognition and tracking of moving objects, the PFTP and BAT, and the configuration parameters of the neural network and boundary line model were analyzed. The results showed an increased tracking accuracy with the proposed methods by 50%. The study results confirmed the relevance of the topic and the effectiveness of the implemented methods and tools.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Autonomous Vehicle Technology and Safety · Infrared Target Detection Methodologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (26)

Show source-provided references
1. OpenDataCam 3.0.2: An open source tool to quantify the world
2. Valladares · Advances in Intelligent Systems and Computing · 2021 · 34310.1007/978-3-030-68017-6_51 ↗
3. Real-time moving objects detection and tracking using Deep-Stream technology
4. Software architecture for analyzing the impact of news on the stock market
5. Vehicle re-identification model based on optimized DenseNet121 with joint loss10.32604/cmc.2021.016560 ↗
6. Real-time small object detection algorithm in UAV-based traffic monitoring
7. Accurate detection and tracking of ants in indoor and outdoor environments
8. Online tracking of ants based on deep association metrics: Method, dataset and evaluation10.1016/j.patcog.2020.107233 ↗
9. Model for real-time object searching and recognizing on mobile platform
10. J. Redmon and A. Farhadi, “YOLOv3: An incremental improvement,” ArXiv, 2018, https://arxiv.org/abs/1804.02767.
11. The multi-phase ReLU activation function
12. D. Misra, “Mish: A self-regularized non-monotonic activation function,” ArXiv, 2019, https://arxiv.org/abs/1908.08681.
13. AlexeyAB/darknet:YOLOv4 (version yolov4)
14. Implementation of Scaled-YOLOv4 using PyTorch framework (v1.0.0)
15. Ultralytics/YOLOv5:v6.0–YOLOv5n ‘Nano’ models, Roboflow integration, TensorFlow export, OpenCV DNN support (v6.0)
16. C. Wang, I. Yeh and H. M. Liao, “You only learn one representation: Unified network for multiple tasks,” ArXiv, 2021, https://arxiv.org/abs/2105.04206.
17. LabelImg
18. Extending IOU based multi-object tracking by visual information
19. Simple online and real-time tracking
20. A. Milan, L. Leal-Taixe, I. Reid, S. Roth and K. Schindler, “MOT16: A benchmark for multi-object tracking,” ArXiv, 2016, https://arxiv.org/abs/1603.00831.
21. MOTChallenge: A benchmark for single-camera multiple target tracking10.1007/s11263-020-01393-0 ↗
22. The hungarian method for the assignment problem
23. M. Skrodzki, “The k-d tree data structure and a proof for neighborhood computation in expected logarithmic time,” ArXiv, 2019, https://arxiv.org/abs/1603.00831.
24. Docker: Lightweight Linux containers for consistent development and deployment
25. Ants dataset (indoor/outdoor Messor Structor) + trained YOLOv4 weights
26. A. Mishra, Machine learning for iOS developers. New York, NY, USA: John Wiley & Sons, 2020. [Online]. Available: https://www.wiley.com/en-ie/Machine+Learning+for+iOS+Developers-p-9781119602903.10.1002/9781119602927 ↗