journal article·2026-04-01Open access

Enhancing flapping foil propulsion through adaptive stiffness scheduling via deep reinforcement learning

Shunhang Chen, Ruipeng Li, Ang Li, Dixia Fan, Zhenbo Lu

AIP Advances· Volume 16· Issue 4

Abstract

Bio-inspired flapping propulsion offers advantages in maneuverability, noise reduction, and adaptability, but its performance is governed by strongly nonlinear fluid–structure interactions between unsteady kinematics and structural compliance. For flexible propulsors with tunable stiffness, it remains unclear how the stiffness level and its within-cycle variation should be designed to improve the propulsive performance under prescribed flapping kinematics. Here, we study a two-dimensional flexible heaving foil at Re = 1100, coupled to a deep reinforcement learning controller that modulates the non-dimensional bending stiffness Kb(t). Three reward weights (β = 0.2, 0.3, and 0.45) are employed to bias the learning objective toward thrust enhancement, a balanced trade-off, or efficiency improvement. Compared with the constant-stiffness baselines, the thrust-oriented setting can boost thrust while maintaining relatively high propulsive efficiency. Relative to the stiffer baseline (Kb = 2.5), the thrust-oriented policy increases thrust by up to 44%. By contrast, the efficiency-oriented setting delivers a smaller thrust gain but achieves the largest efficiency improvement, with up to a 76% increase in propulsive efficiency relative to the same stiffer baseline. Across β, thrust-oriented solutions operate at a higher overall stiffness level than efficiency-oriented ones. For the high-stiffness group (β = 0.2 and 0.3), increasing stiffness around stroke reversal suppresses the deformation lag that occurs when the foil is overly compliant, so the instantaneous attitude and pressure loading project more effectively onto the thrust direction. This reversal-stage stiffening also helps preserve the load by preventing excessive bending from weakening the pressure-driven thrust contribution. In contrast, softening near mid-stroke allows controlled camber to develop, which can enhance favorable pressure projection while avoiding the large reactive loads and sharp power spikes associated with constant-stiffness foils. These findings provide a compact control principle for bio-inspired propulsors: phase-aware stiffness modulation can improve the thrust–power trade-off without altering the prescribed kinematics.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Biomimetic flight and propulsion mechanisms · Micro and Nano Robotics · Fluid Dynamics and Vibration Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Aeronautics and Astronautics, Shenzhen Campus of Sun Yat-sen University 1 , Shenzhen 518107,

School of Aeronautics and Astronautics, Sun Yat-sen University 2 , Shenzhen 518107,

Key Laboratory of 3D Micro/nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University 3 , Hangzhou,

Funding

Natural Science Foundation of Shenzhen Municipality · National Natural Science Foundation of China · Aeronautical Science Foundation of China · Department of Science and Technology of Guangdong Province · Guangdong Basic and Applied Basic Research Foundation

References (46)

Show source-provided references
1. Swimming of a waving plate10.1017/s0022112061000949 ↗
2. Scaling the propulsive performance of heaving flexible panels10.1017/jfm.2013.597 ↗
3. Maximizing the efficiency of a flexible propulsor using experimental optimization10.1017/jfm.2015.35 ↗
4. Resonance and propulsion performance of a heaving flexible wing10.1063/1.3177356 ↗
5. Effects of flexibility on the aerodynamic performance of flapping wings10.1017/jfm.2011.428 ↗
6. Influence of complex driving motion on propulsion performance of a heaving flexible foil10.1088/1748-3190/aaf17a ↗
7. Scaling laws for the thrust production of flexible pitching panels10.1017/jfm.2013.384 ↗
8. Distributed flexibility in inertial swimmers10.1017/jfm.2020.49 ↗
9. Effect of body stiffness distribution on larval fish–like efficient undulatory swimming10.1126/sciadv.abf7364 ↗
10. Effects of body stiffness on propulsion during fish self-propelled swimming10.1063/5.0156923 ↗
11. Effects of stiffness distribution and spanwise deformation on the dynamics of a ray-supported caudal fin10.1088/1748-3190/aa5d3f ↗
12. Tunable stiffness in fish robotics: Mechanisms and advantages10.1088/1748-3190/ac3ca5 ↗
13. Are muscle fibers within fish myotomes activated synchronously? Patterns of recruitment within deep myomeric musculature during swimming in largemouth bass10.1242/jeb.198.3.805 ↗
14. Body stiffness variation of a tensegrity robotic fish using antagonistic stiffness in a kinematically singular configuration10.1109/tro.2021.3049430 ↗
15. A soft robotic fish with variable-stiffness decoupled mechanisms10.1007/s42235-018-0049-1 ↗
16. Tunable stiffness enables fast and efficient swimming in fish-like robots10.1126/scirobotics.abe4088 ↗
17. An active torque model for regulating tuna finlets10.1063/5.0231384 ↗
18. How a self-propelled fin gains hydrodynamic advantages behind a circular cylinder with vortex-induced vibrations10.1017/jfm.2025.355 ↗
19. Clarifying the relationship between efficiency and resonance for flexible inertial swimmers10.1017/jfm.2018.581 ↗
20. Comparing analytically propulsion by pitching and heaving flexible foils near the first two natural modes10.1017/jfm.2025.10390 ↗
21. Analytical results for pitching kinematics and propulsion performance of flexible foil10.1017/jfm.2023.1028 ↗
22. Torsional spring is the optimal flexibility arrangement for thrust production of a flapping wing10.1063/1.4930235 ↗
23. Propulsive performance of oscillating plates with time-periodic flexibility10.1017/jfm.2023.166 ↗
24. Nonlinear tunable stiffness for high-efficiency biomimetic propulsion10.1017/jfm.2025.10440 ↗
25. Effects of time-varying flexibility on the propulsion performance of a flapping foil10.1063/5.0027927 ↗
26. Effects of antagonistic muscle actuation on the bilaminar structure of ray-finned fish in propulsion10.1017/jfm.2023.839 ↗
27. Enhancing propulsion performance of a flexible heaving foil through dynamically adjusting its flexibility10.1088/1748-3190/ab45d9 ↗
28. Recent advances in applying deep reinforcement learning for flow control: Perspectives and future directions10.1063/5.0143913 ↗
29. Artificial neural networks trained through deep reinforcement learning discover control strategies for active flow control10.1017/jfm.2019.62 ↗
30. Deep reinforcement learning in fluid mechanics: A promising method for both active flow control and shape optimization10.1007/s42241-020-0028-y ↗
31. Applying deep reinforcement learning to active flow control in weakly turbulent conditions10.1063/5.0037371 ↗
32. Reinforcement learning for bluff body active flow control in experiments and simulations10.1073/pnas.2004939117 ↗
33. Study on Liutex-driven reward for intelligent flow control by dynamic feature-based deep reinforcement learning10.1063/5.0271616 ↗
34. Optimization of fluid control laws through deep reinforcement learning using dynamic mode decomposition as the environment10.1063/5.0237682 ↗
35. Learn to flap: Foil non-parametric path planning via deep reinforcement learning10.1017/jfm.2023.1096 ↗
36. Lift enhancement of a butterfly-like flapping wing vehicle by reinforcement learning algorithm10.1088/1748-3190/acd3cc ↗
37. Development of lattice-Boltzmann flux solver for simulation of incompressible flows10.4208/aamm.2014.4.s2 ↗
38. An immersed boundary-lattice Boltzmann flux solver and its applications to fluid–structure interaction problems10.1016/j.jfluidstructs.2014.12.003 ↗
39. Efficient boundary condition-enforced immersed boundary method for incompressible flows with moving boundaries10.1016/j.jcp.2021.110425 ↗
40. Hydrodynamic performance of an unconstrained flapping swimmer with flexible fin: A numerical study10.1063/5.0077312 ↗
41. Flow control of a circular cylinder by using an attached flexible filament10.1063/1.4896942 ↗
42. Effect of active leading-edge morphing on the vortex dynamics and propulsive performance of a heaving plate10.1016/j.oceaneng.2025.122723 ↗
43. Stable-baselines3: Reliable reinforcement learning implementations
44. Classification of vortex patterns of oscillating foils in side-by-side configurations10.1017/jfm.2022.785 ↗
45. High-order accurate simulations of unsteady flow past plunging and pitching airfoils10.1016/j.compfluid.2010.09.005 ↗
46. How flexibility affects the wake symmetry properties of a self-propelled plunging foil10.1017/jfm.2014.310 ↗