journal article·2024-10-22Open access

A Computationally Efficient Neuronal Model for Collision Detection with Contrast Polarity-Specific Feed-Forward Inhibition

Guangxuan Gao, Renyuan Liu, Mengying Wang, Qinbing Fu

Biomimetics· Volume 9· Issue 11

Abstract

Animals utilize their well-evolved dynamic vision systems to perceive and evade collision threats. Driven by biological research, bio-inspired models based on lobula giant movement detectors (LGMDs) address certain gaps in constructing artificial collision-detecting vision systems with robust selectivity, offering reliable, low-cost, and miniaturized collision sensors across various scenes. Recent progress in neuroscience has revealed the energetic advantages of dendritic arrangements presynaptic to the LGMDs, which receive contrast polarity-specific signals on separate dendritic fields. Specifically, feed-forward inhibitory inputs arise from parallel ON/OFF pathways interacting with excitation. However, none of the previous research has investigated the evolution of a computational LGMD model with feed-forward inhibition (FFI) separated by opposite polarity. This study fills this vacancy by presenting an optimized neuronal model where FFI is divided into ON/OFF channels, each with distinct synaptic connections. To align with the energy efficiency of biological systems, we introduce an activation function associated with neural computation of FFI and interactions between local excitation and lateral inhibition within ON/OFF channels, ignoring non-active signal processing. This approach significantly improves the time efficiency of the LGMD model, focusing only on substantial luminance changes in image streams. The proposed neuronal model not only accelerates visual processing in relatively stationary scenes but also maintains robust selectivity to ON/OFF-contrast looming stimuli. Additionally, it can suppress translational motion to a moderate extent. Comparative testing with state-of-the-art based on ON/OFF channels was conducted systematically using a range of visual stimuli, including indoor structured and complex outdoor scenes. The results demonstrated significant time savings in silico while retaining original collision selectivity. Furthermore, the optimized model was implemented in the embedded vision system of a micro-mobile robot, achieving the highest success ratio of collision avoidance at 97.51% while nearly halving the processing time compared with previous models. This highlights a robust and parsimonious collision-sensing mode that effectively addresses real-world challenges.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Neuroscience and Neural Engineering · Neural dynamics and brain function

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Machine Life and Intelligence Research Centre, School of Mathematics and Information Science, Guangzhou University, Guangzhou 510006, China

Funding

National Natural Science Foundation of China · Social Science Fund of the Ministry of Education of China

References (64)

Show source-provided references
1. Towards computational models and applications of insect visual systems for motion perception: A review10.1162/artl_a_00297 ↗
2. Autonomous unmanned aerial vehicle navigation using reinforcement learning: A systematic review10.1016/j.engappai.2022.105321 ↗
3. Collision sensing by stereo vision and radar sensor fusion10.1109/TITS.2009.2032769 ↗
4. Using infrared sensors for distance measurement in mobile robots10.1016/S0921-8890(02)00271-3 ↗
5. Fusion of laser and visual data for robot motion planning and collision avoidance10.1007/s00138-003-0133-2 ↗
6. Horswill, I. (1995, January 5–9). Visual collision avoidance by segmentation. Proceedings of the Intelligent Robots and Systems, Pittsburgh, PA, USA.10.1016/B978-044482250-5/50008-6 ↗
7. John, S.N., Noma-Osaghae, E., Okokpujie, K., Okereke, C., Ananaba, J., and Omoruyi, O. (2019, January 5–7). Vehicle collision avoidance system using localization algorithm and predictive analysis. Proceedings of the 2019 International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, NV, USA.
8. Ultra-selective looming detection from radial motion opponency10.1038/nature24626 ↗
9. Characterization and modelling of looming-sensitive neurons in the crab Neohelice10.1007/s00359-018-1257-1 ↗
10. Cope, A.J., Sabo, C., Gurney, K., Vasilaki, E., and Marshall, J.A. (2016). A model for an angular velocity-tuned motion detector accounting for deviations in the corridor-centering response of the bee. PLoS Comput. Biol., 12.10.1371/journal.pcbi.1004887 ↗
11. Small brains, smart machines: From fly vision to robot vision and back again10.1109/JPROC.2014.2312916 ↗
12. Optic flow-based collision-free strategies: From insects to robots10.1016/j.asd.2017.06.003 ↗
13. Hua, M., Fu, Q., Peng, J., Yue, S., and Luan, H. (2022, January 18–23). Shaping the ultra-selectivity of a looming detection neural network from non-linear correlation of radial motion. Proceedings of the 2022 International Joint Conference on Neural Networks (IJCNN), Padua, Italy.10.1109/IJCNN55064.2022.9892408 ↗
14. Miniature curved artificial compound eyes10.1073/pnas.1219068110 ↗
15. Finding the gap: Neuromorphic motion vision in dense environments10.1038/s41467-024-45063-y ↗
16. Rind, F.C., Wernitznig, S., Pölt, P., Zankel, A., Gütl, D., Sztarker, J., and Leitinger, G. (2016). Two identified looming detectors in the locust: Ubiquitous lateral connections among their inputs contribute to selective responses to looming objects. Sci. Rep., 6.10.1038/srep35525 ↗
17. A pair of motion-sensitive neurons in the locust encode approaches of a looming object10.1007/s00359-010-0576-7 ↗
18. Collision detection in complex dynamic scenes using an LGMD-based visual neural network with feature enhancement10.1109/TNN.2006.873286 ↗
19. A robust collision perception visual neural network with specific selectivity to darker objects10.1109/TCYB.2019.2946090 ↗
20. Shaping the collision selectivity in a looming sensitive neuron model with parallel on and off pathways and spike frequency adaptation10.1016/j.neunet.2018.04.001 ↗
21. Motion perception based on ON/OFF channels: A survey10.1016/j.neunet.2023.05.031 ↗
22. Feedforward inhibition conveys time-varying stimulus information in a collision detection circuit10.1016/j.cub.2018.04.007 ↗
23. Intracellular characterization of neurons in the locust brain signaling impending collision10.1152/jn.1996.75.3.986 ↗
24. Pre-synaptic Muscarinic Excitation Enhances the Discrimination of Looming Stimuli in a Collision-Detection Neuron10.1016/j.celrep.2018.04.079 ↗
25. Contrast polarity-specific mapping improves efficiency of neuronal computation for collision detection10.7554/eLife.79772 ↗
26. Seeing what is coming: Building collision-sensitive neurones10.1016/S0166-2236(98)01332-0 ↗
27. A look into the cockpit of the developing locust: Looming detectors and predator avoidance10.1002/dneu.22184 ↗
28. Optic-flow-based collision avoidance10.1109/MRA.2008.919023 ↗
29. Brinkworth, R.S., and O’Carroll, D.C. (2009). Robust models for optic flow coding in natural scenes inspired by insect biology. PLoS Comput. Biol., 5.10.1371/journal.pcbi.1000555 ↗
30. Bertrand, O.J., Lindemann, J.P., and Egelhaaf, M. (2015). A bio-inspired collision avoidance model based on spatial information derived from motion detectors leads to common routes. PLoS Comput. Biol., 11.10.1371/journal.pcbi.1004339 ↗
31. Serres, J., and Ruffier, F. (2016). Optic fLow-Based Robotics, John Wiley & Sons, Inc.10.1002/047134608X.W8321 ↗
32. Insect inspired autopilots10.5226/jabmech.1.2 ↗
33. Shallow neural networks trained to detect collisions recover features of visual loom-selective neurons10.7554/eLife.72067 ↗
34. A fly inspired solution to looming detection for collision avoidance10.1016/j.isci.2023.106337 ↗
35. Visual projection neurons in the Drosophila lobula link feature detection to distinct behavioral programs10.7554/eLife.21022 ↗
36. A functionally ordered visual feature map in the Drosophila brain10.1016/j.neuron.2022.02.013 ↗
37. Santer, R.D., Rind, F.C., and Simmons, P.J. (2012). Predator versus prey: Locust looming-detector neuron and behavioural responses to stimuli representing attacking bird predators. PLoS ONE, 7.10.1371/journal.pone.0050146 ↗
38. Escapes with and without preparation: The neuroethology of visual startle in locusts10.1016/j.jinsphys.2010.04.015 ↗
39. Synaptic connections of first-stage visual neurons in the locust Schistocerca gregaria extend evolution of tetrad synapses back 200 million years10.1002/cne.23682 ↗
40. Background visual motion affects responses of an insect motion-sensitive neuron to objects deviating from a collision course10.14814/phy2.12801 ↗
41. Immunocytochemical evidence that collision sensing neurons in the locust visual system contain acetylcholine10.1002/1096-9861(20000731)423:3<389::AID-CNE3>3.0.CO;2-S ↗
42. Arousal facilitates collision avoidance mediated by a looming sensitive visual neuron in a flying locust10.1152/jn.01055.2007 ↗
43. Orthopteran DCMD neuron: A reevaluation of responses to moving objects. I. Selective responses to approaching objects10.1152/jn.1992.68.5.1654 ↗
44. Local circuit for the computation of object approach by an identified visual neuron in the locust10.1002/(SICI)1096-9861(19980808)395:3<405::AID-CNE9>3.0.CO;2-6 ↗
45. Multiplication and stimulus invariance in a looming-sensitive neuron
46. Bermúdez i Badia, S., Bernardet, U., and Verschure, P.F. (2010). Non-linear neuronal responses as an emergent property of afferent networks: A case study of the locust lobula giant movement detector. PLoS Comput. Biol., 6.10.1371/journal.pcbi.1000701 ↗
47. Neural network based on the input organization of an identified neuron signaling impending collision10.1152/jn.1996.75.3.967 ↗
48. Activity of descending contralateral movement detector neurons and collision avoidance behaviour in response to head-on visual stimuli in locusts10.1007/s003590100182 ↗
49. The locust DCMD, a movement-detecting neurone tightly tuned to collision trajectories10.1242/jeb.200.16.2209 ↗
50. Looming detection by identified visual interneurons during larval development of the locust Locusta migratoria
51. Responses to object approach by a wide field visual neurone, the LGMD2 of the locust: Characterization and image cues10.1007/s003590050041 ↗
52. Motion detection in flies: Parametric control over ON-OFF pathways10.1007/BF00236243 ↗
53. Territorial organization of direction-selective ganglion cells in rabbit retina10.1523/JNEUROSCI.14-11-06301.1994 ↗
54. Identification of ON–OFF direction-selective ganglion cells in the mouse retina10.1113/jphysiol.2004.076695 ↗
55. Contrast-invariant orientation tuning in cat visual cortex: Thalamocortical input tuning and correlation-based intracortical connectivity10.1523/JNEUROSCI.18-15-05908.1998 ↗
56. Orientation selectivity from very sparse LGN inputs in a comprehensive model of macaque V1 cortex10.1523/JNEUROSCI.2603-16.2016 ↗
57. Correlation between OFF and ON channels underlies dark target selectivity in an insect visual system10.1523/JNEUROSCI.1277-13.2013 ↗
58. Fu, Q., Hu, C., Liu, P., and Yue, S. (2018, January 25–27). Towards Computational Models of Insect Motion Detectors for Robot Vision. Proceedings of the Towards Autonomous Robotic Systems Conference, Bristol, UK.
59. Transfer of graded potentials at the photoreceptor-interneuron synapse10.1085/jgp.105.1.117 ↗
60. On-off units in the first optic chiasm of the blowfly II. Spatial properties10.1007/BF00213528 ↗
61. Mechanisms of early visual processing in the medulla of the locust optic lobe: How self-inhibition, spatial-pooling, and signal rectification contribute to the properties of transient cells10.1017/S0952523800004831 ↗
62. Improved collision perception neuronal system model with adaptive inhibition mechanism and evolutionary learning10.1109/ACCESS.2020.3001396 ↗
63. Hu, C., Fu, Q., and Yue, S. (2018). Colias IV: The affordable micro robot platform with bio-inspired vision. Annual Conference Towards Autonomous Robotic Systems Proceedings of the Annual Conference Towards Autonomous Robotic Systems, Bristol, UK, 25–27 July 2018, Springer.10.1007/978-3-319-96728-8_17 ↗
64. A Practical Multirobot Localization System10.1007/s10846-014-0041-x ↗