journal article·2025-02-06Open access

A Bio-Inspired Visual Network That Fuses Motion and Contrast Features for Detecting Small Moving Objects in Dynamic Complex Environments

Jun Ling, Hecheng Meng, Deming Gong

Applied Sciences· Volume 15· Issue 3

Abstract

In complex and dynamic environments, traditional motion detection techniques that rely on visual feature extraction face significant challenges when detecting and tracking small-sized moving objects. These difficulties primarily stem from the limited feature information inherent in small objects and the substantial interference caused by irrelevant information in complex backgrounds. Inspired by the intricate mechanisms for detecting small moving objects in insect brains, some bio-inspired systems have been designed to identify small moving objects in dynamic natural backgrounds. While these insect-inspired systems can effectively utilize motion information for object detection, they still suffer from limitations in suppressing complex background interference and accurately segmenting small objects, leading to a high rate of false positives from the complex background in their detection results. To overcome this limitation, inspired by insect visual neural structures, we propose a novel dual-channel visual network. The network first utilizes a motion detection channel to extract the target’s motion position information and track its trajectory. Simultaneously, a contrast detection channel extracts the target’s local contrast information. Then, based on the target’s motion trajectory, we determine the temporal variation trajectory of the target’s contrast. Finally, by comparing the temporal fluctuation characteristics of the contrast between the target and background false positives, the network can effectively distinguish between the target and background, thereby suppressing false positives. The experimental results show that the visual network performs excellently in terms of detection rate and precision, with an average detection rate of 0.81 and an average precision as high as 0.0968, which are significantly better than those of other comparative methods. This indicates that it has a significant advantage in suppressing false alarms and identifying small targets in complex dynamic environments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrared Target Detection Methodologies · Advanced Measurement and Detection Methods · Video Surveillance and Tracking Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Food Science and Engineering, South China University of Technology, Guangzhou 510006, China

Postdoctoral Research Workstation of Mltor Numerical Control Technology Limited Company, Zhongshan 528400, China

References (67)

Show source-provided references
1. Bio-inspired approaches for autonomous small-object detection and avoidance10.1109/TRO.2019.2922472 ↗
2. Li, J., Liang, X., Wei, Y., Xu, T., Feng, J., and Yan, S. (2017, January 21–26). Perceptual generative adversarial networks for small object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.211 ↗
3. Background subtraction in real applications: Challenges, current models and future directions
4. Background subtraction for moving object detection: Explorations of recent developments and challenges
5. Shuigen, W., Zhen, C., and Hua, D. (2009, January 22–24). Motion detection based on temporal difference method and optical flow field. Proceedings of the 2009 Second International Symposium on Electronic Commerce and Security, Nanchang, China.10.1109/ISECS.2009.62 ↗
6. Optical flow modeling and computation: A survey10.1016/j.cviu.2015.02.008 ↗
7. Kačan, M., Turčinović, F., Bojanjac, D., and Bosiljevac, M. (2022). Deep learning approach for object classification on raw and reconstructed gbsar data. Remote Sens., 14.10.3390/rs14225673 ↗
8. Distilling knowledge from object classification to aesthetics assessment10.1109/TCSVT.2022.3186307 ↗
9. Ensemble deep learning using faster r-cnn and genetic algorithm for vehicle detection in uav images10.1080/03772063.2021.1962418 ↗
10. MEANet: An effective and lightweight solution for salient object detection in optical remote sensing images10.1016/j.eswa.2023.121778 ↗
11. Poolnet+: Exploring the potential of pooling for salient object detection10.1109/TPAMI.2021.3140168 ↗
12. Internal models direct dragonfly interception steering10.1038/nature14045 ↗
13. Retinotopic organization of small-field-target-detecting neurons in the insect visual system10.1016/j.cub.2007.02.039 ↗
14. Object-detecting neurons in Drosophila10.1016/j.cub.2017.01.012 ↗
15. Nordström, K., Barnett, P.D., and O’Carroll, D.C. (2006). Insect detection of small targets moving in visual clutter. PLoS Biol., 4.10.1371/journal.pbio.0040054 ↗
16. Wiederman, S.D., Shoemaker, P.A., and O’Carroll, D.C. (2008). A model for the detection of moving targets in visual clutter inspired by insect physiology. PloS ONE, 3.10.1371/journal.pone.0002784 ↗
17. A directionally selective small target motion detecting visual neural network in cluttered backgrounds10.1109/TCYB.2018.2869384 ↗
18. Biologically inspired feature detection using cascaded correlations of off and on channels
19. Wiederman, S.D., and O’Carroll, D.C. (2013, January 16–19). Biomimetic target detection: Modeling 2nd order correlation of off and on channels. Proceedings of the 2013 IEEE Symposium on Computational Intelligence for Multimedia, Signal and Vision Processing (CIMSIVP), Singapore.10.1109/CIMSIVP.2013.6583842 ↗
20. A time-delay feedback neural network for discriminating small, fast-moving targets in complex dynamic environments10.1109/TNNLS.2021.3094205 ↗
21. Ling, J., Wang, H., Xu, M., Chen, H., Li, H., and Peng, J. (2022). Mathematical study of neural feedback roles in small target motion detection. Front. Neurorobot., 16.10.3389/fnbot.2022.984430 ↗
22. A fractional-order visual neural model for small target motion detection10.1016/j.neucom.2023.126459 ↗
23. Attention and prediction-guided motion detection for low-contrast small moving targets10.1109/TCYB.2022.3170699 ↗
24. Rigid propagation of visual motion in the insect’s neural system10.1016/j.neunet.2024.106874 ↗
25. Billah, M.A., and Faruque, I.A. (2022, January 8–10). Modeling Small-Target Motion Detector Neurons as Switched Systems with Dwell Time Constraints. Proceedings of the 2022 American Control Conference (ACC), Atlanta, GA, USA.10.23919/ACC53348.2022.9867750 ↗
26. Uzair, M., Finn, A., and Brinkworth, R.S. (2023, January 29–30). Efficient Sampling of Bayer Pattern for Long Range Small Target Detection in Color Images. Proceedings of the 2023 38th International Conference on Image and Vision Computing New Zealand (IVCNZ), Palmerston North, New Zealand.10.1109/IVCNZ61134.2023.10343977 ↗
27. Uzair, M., Brinkworth, R.S., and Finn, A. (2021). Detecting small size and minimal thermal signature targets in infrared imagery using biologically inspired vision. Neuron, 21.10.3390/s21051812 ↗
28. A bio-inspired spatiotemporal contrast operator for small and low-heat-signature target detection in infrared imagery
29. GABAergic lateral interactions tune the early stages of visual processing in Drosophila10.1016/j.neuron.2013.04.024 ↗
30. Processing properties of ON and OFF pathways for Drosophila motion detection10.1038/nature13427 ↗
31. A Small Target Motion Detection Algorithm in Complex Dynamic Environment
32. Contributions of the 12 neuron classes in the fly lamina to motion vision10.1016/j.neuron.2013.05.024 ↗
33. Parallel computations in insect and mammalian visual motion processing10.1016/j.cub.2016.08.003 ↗
34. Adaptations for nocturnal and diurnal vision in the hawkmoth lamina10.1002/cne.23832 ↗
35. A neuronally based model of contrast gain adaptation in fly motion vision10.1017/S095252381100023X ↗
36. Rind, F.C., Wernitznig, S., Pölt, P., Zankel, A., Gütl, D., Sztarker, J., and Leitinger, G. (2016). Two identified looming detectors in the locust: Ubiquitous lateral connections among their inputs contribute to selective responses to looming objects. Sci. Rep., 6.10.1038/srep35525 ↗
37. Neural network based on the input organization of an identified neuron signaling impending collision10.1152/jn.1996.75.3.967 ↗
38. A directional tuning map of Drosophila elementary motion detectors10.1038/nature12320 ↗
39. Generation and evolution of neural cell types and circuits: Insights from the Drosophila visual system10.1146/annurev-genet-120215-035312 ↗
40. Collision detection in complex dynamic scenes using an LGMD-based visual neural network with feature enhancement10.1109/TNN.2006.873286 ↗
41. Redundant neural vision systems—Competing for collision recognition roles10.1109/TAMD.2013.2255050 ↗
42. Systemtheoretische analyse der zeit-, reihenfolgen-und vorzeichenauswertung bei der bewegungsperzeption des rüsselkäfers chlorophanus10.1515/znb-1956-9-1004 ↗
43. Defining the computational structure of the motion detector in Drosophila10.1016/j.neuron.2011.05.023 ↗
44. Matched filtering and the ecology of vision in insects10.1007/978-3-319-25492-0_6 ↗
45. Infrared small target detection utilizing the multiscale relative local contrast measure10.1109/LGRS.2018.2790909 ↗
46. Infrared small target detection based on multiscale local contrast measure using local energy factor10.1109/LGRS.2019.2914432 ↗
47. Gaussian scale-space enhanced local contrast measure for small infrared target detection10.1109/LGRS.2019.2917825 ↗
48. Zhao, X., Zhang, L., Pang, Y., Lu, H., and Zhang, L. (2020, January 23–28). A single stream network for robust and real-time RGB-D salient object detection. Proceedings of the Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK.10.1007/978-3-030-58542-6_39 ↗
49. Liu, W., Ren, G., Yu, R., Guo, S., Zhu, J., and Zhang, L. (March, January 22). Image-adaptive YOLO for object detection in adverse weather conditions. Proceedings of the AAAI Conference on Artificial Intelligence, Palo Alto, CA, USA.
50. Underwater image enhancement via minimal color loss and locally adaptive contrast enhancement10.1109/TIP.2022.3177129 ↗
51. Zhang, L., and Peng, Z. (2019). Infrared small target detection based on partial sum of the tensor nuclear norm. Remote Sens., 11.10.3390/rs11040382 ↗
52. An infrared small target detection method based on multiscale local homogeneity measure10.1016/j.infrared.2018.03.006 ↗
53. Infrared small target detection based on local intensity and gradient properties10.1016/j.infrared.2017.12.018 ↗
54. Dai, Y., Wu, Y., Zhou, F., and Barnard, K. (2021, January 3–8). Asymmetric contextual modulation for infrared small target detection. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV48630.2021.00099 ↗
55. Dense nested attention network for infrared small target detection10.1109/TIP.2022.3199107 ↗
56. Infrared small target detection via nonconvex tensor fibered rank approximation
57. Common circuit design in fly and mammalian motion vision10.1038/nn.4050 ↗
58. Design principles of insect and vertebrate visual systems10.1016/j.neuron.2010.01.018 ↗
59. De Vries, B., and Príncipe, J. (1990, January 26–29). A theory for neural networks with time delays. Proceedings of the Advances in Neural Information Processing Systems 3, Denver, CO, USA.
60. ON and OFF pathways in Drosophila motion vision10.1038/nature09545 ↗
61. Feature-detecting neurons in dragonflies10.1038/362541a0 ↗
62. Eight pairs of descending visual neurons in the dragonfly give wing motor centers accurate population vector of prey direction10.1073/pnas.1210489109 ↗
63. Lessios, N., Rutowski, R.L., Cohen, J.H., Sayre, M.E., and Strausfeld, N.J. (2018). Multiple spectral channels in branchiopods. I. Vision in dim light and neural correlates. J. Exp. Biol., 221.10.1242/jeb.165860 ↗
64. Rogers, S.M., and Ott, S.R. (2015). Differential activation of serotonergic neurons during short-and long-term gregarization of desert locusts. Proc. Biol. Sci., 282.10.1098/rspb.2014.2062 ↗
65. Photoreceptors and neural circuitry underlying phototaxis in insects10.4161/fly.5.4.16419 ↗
66. Vision egg: An open-source library for realtime visual stimulus generation10.3389/neuro.11.004.2008 ↗
67. (2020, April 06). RIST Data Set. Available online: https://sites.google.com/view/hongxinwang-personalsite/download/.