Fish-inspired tracking of underwater turbulent plumes
Source abstract
Abstract
Abstract Autonomous ocean-exploring vehicles have begun to take advantage of onboard sensor measurements of water properties such as salinity and temperature to locate oceanic features in real time. Such targeted sampling strategies enable more rapid study of ocean environments by actively steering towards areas of high scientific value. Inspired by the ability of aquatic animals to navigate via flow sensing, this work investigates hydrodynamic cues for accomplishing targeted sampling using a palm-sized robotic swimmer. As proof-of-concept analogy for tracking hydrothermal vent plumes in the ocean, the robot is tasked with locating the center of turbulent jet flows in a 13,000-liter water tank using data from onboard pressure sensors. To learn a navigation strategy, we first implemented RL on a simulated version of the robot navigating in proximity to turbulent jets. After training, the RL algorithm discovered an effective strategy for locating the jets by following transverse velocity gradients sensed by pressure sensors located on opposite sides of the robot. When implemented on the physical robot, this gradient following strategy enabled the robot to successfully locate the turbulent plumes at more than twice the rate of random searching. Additionally, we found that navigation performance improved as the distance between the pressure sensors increased, which can inform the design of distributed flow sensors in ocean robots. Our results demonstrate the effectiveness and limits of flow-based navigation for autonomously locating hydrodynamic features of interest.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Underwater Vehicles and Communication Systems · Biomimetic flight and propulsion mechanisms · Reinforcement Learning in Robotics
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (56)
Show source-provided references
1. Seafloor mapping—the challenge of a truly global ocean bathymetry10.3389/fmars.2019.00283 ↗
2. Known and unknown biodiversity, risk of extinction and conservation strategy in the sea
3. Decadal trends in the ocean carbon sink10.1073/pnas.1900371116 ↗
4. Ocean time series observations of changing marine ecosystems: an era of integration, synthesis and societal applications10.3389/fmars.2019.00393 ↗
5. Ocean research enabled by underwater gliders10.1146/annurev-marine-122414-033913 ↗
6. Argo data 1999–2019: two million temperature-salinity profiles and subsurface velocity observations from a global array of profiling floats10.3389/fmars.2020.00700 ↗
7. Challenges and future trends in marine robotics10.1016/j.arcontrol.2018.10.002 ↗
8. Targeted sampling by autonomous underwater vehicles10.3389/fmars.2019.00415 ↗
9. Visual tracking of deepwater animals using machine learning-controlled robotic underwater vehicles
10. Robotic planning under uncertainty in spatiotemporal environments in expeditionary science
11. Autonomous tracking of salinity-intrusion fronts by a long-range autonomous underwater vehicle10.1109/JOE.2022.3146584 ↗
12. Tracking wakes: the nocturnal predatory strategy of piscivorous catfish10.1073/pnas.121026298 ↗
13. Hydrodynamic trail-following in harbor seals (Phoca vitulina)10.1126/science.1060514 ↗
14. Active wall following by Mexican blind cavefish (Astyanax mexicanus)10.1007/s00359-010-0567-8 ↗
15. A review of fish swimming mechanics and behaviour in altered flows10.1098/rstb.2007.2082 ↗
16. Measuring fluid flow and heat output in seafloor hydrothermal environments10.1002/2015JB012245 ↗
17. The role of hydrodynamics in collective motions of fish schools and bioinspired underwater robots10.1098/rsif.2023.0357 ↗
18. Sensing the flow beneath the fins10.1088/1748-3190/aaa1c2 ↗
19. Creating underwater vision through wavy whiskers: a review of the flow-sensing mechanisms and biomimetic potential of seal whiskers10.1098/rsif.2021.0629 ↗
20. Fish lateral line inspired flow sensors and flow-aided control: a review10.1007/s42235-021-0034-y ↗
21. Distributed flow estimation and closed-loop control of an underwater vehicle with a multi-modal artificial lateral line10.1088/1748-3190/10/2/025002 ↗
22. Imaging dipole flow sources using an artificial lateral-line system made of biomimetic hair flow sensors10.1098/rsif.2013.0162 ↗
23. Wall following control of a robotic fish using dynamic pressure
24. Online state estimation of a fin-actuated underwater robot using artificial lateral line system10.1109/TRO.2019.2956343 ↗
25. Surfing on turbulence: a strategy for planktonic navigation10.1103/PhysRevLett.129.064502 ↗
26. Flowtaxis in the wakes of oscillating airfoils10.1007/s00162-020-00546-8 ↗
27. Against the flow: a Braitenberg controller for a fish robot
28. Sensing oscillations in unsteady flow for better robotic swimming efficiency
29. Local flow characterization using bioinspired sensory information10.1017/jfm.2017.137 ↗
30. A novel mechanism for mechanosensory-based rheotaxis in larval zebrafish10.1038/nature23014 ↗
31. Glider soaring via reinforcement learning in the field10.1038/s41586-018-0533-0 ↗
32. Optimal flow sensing for schooling swimmers10.3390/biomimetics5010010 ↗
33. Emergent behaviour and neural dynamics in artificial agents tracking odour plumes10.1038/s42256-022-00599-w ↗
34. Interpretable and generalizable strategies for stably following hydrodynamic trails10.1101/2023.12.15.571932 ↗
35. Learning efficient navigation in vortical flow fields10.1038/s41467-021-27015-y ↗
36. Dynamic robotic tracking of underwater targets using reinforcement learning10.1126/scirobotics.ade7811 ↗
37. Challenges of real-world reinforcement learning: definitions, benchmarks and analysis10.1007/s10994-021-05961-4 ↗
38. Empirical assessment and comparison of neuro-evolutionary methods for the automatic off-line design of robot swarms10.1038/s41467-021-24642-3 ↗
39. Deep reinforcement learning with double Q-learning, version: 3
40. A unified approach to interpreting model predictions
41. Cave pearl data logger: a flexible Arduino-based logging platform for long-term monitoring in harsh environments10.3390/s18020530 ↗
42. Hydrodynamic pressure sensing with an artificial lateral line in steady and unsteady flows10.1088/1748-3182/7/3/036004 ↗
43. Flexible and surface-mountable piezoelectric sensor arrays for underwater sensing in marine vehicles10.1109/JSEN.2013.2259227 ↗
44. Artificial lateral line based relative state estimation between an upstream oscillating fin and a downstream robotic fish10.1088/1748-3190/abb86c ↗
45. Particle image velocimetry for MATLAB: accuracy and enhanced algorithms in PIVlab10.5334/jors.334 ↗
46. Computational study of microplastic transport at the water-air interface with a memory-optimized lattice Boltzmann method
47. Reliability assessment of off-policy deep reinforcement learning: a benchmark for aerodynamics10.1017/dce.2023.28 ↗
48. Zermelo’s problem: optimal point-to-point navigation in 2D turbulent flows using reinforcement learning10.1063/1.5120370 ↗
49. Choset · 1998 · 203
50. Braitenberg · 1986
51. Lateral line system of fish10.1111/j.1749-4877.2008.00131.x ↗
52. Joint estimation of bulk flow velocity and angle using a lateral line probe10.1109/TIM.2015.2499019 ↗
53. Self-motion effects on hydrodynamic pressure sensing: part I. Forward–backward motion10.1088/1748-3182/8/2/026001 ↗
54. Machine learning for flow-informed aerodynamic control in turbulent wind conditions10.1038/s44172-022-00046-z ↗
55. Odor tracking in aquatic organisms: the importance of temporal and spatial intermittency of the turbulent plume10.1038/s41598-020-64766-y ↗
56. Odour motion sensing enhances navigation of complex plumes10.1038/s41586-022-05423-4 ↗