Design of model-free reinforcement learning control for tunable vibration absorber system based on magnetorheological elastomer
Source abstract
Abstract
Abstract This paper proposes a novel model-free reinforcement learning (RL) for vibration control of a magnetorheological elastomer (MRE)-based application. Because the modeling of the MRE stiffness is nonlinear and time-varying depending on various environmental factors, this paper approached the MRE control issue via a model-free learning based method. In this study, an RL model is designed for the MRE-based tunable vibration absorber (TVA) which can control the optimal stiffness of MRE to maximize the vibration suppression. The designed RL algorithm continuously learns and updates the optimal control input of the MRE stiffness adaptively to the dynamic environment without using any prior knowledge of the MRE modeling. From analyzing the mechanism of MRE TVA, the RL algorithm and parameters are carefully designed for a high vibration performance. Also, this study proposed several ideas to make the RL model simpler and converge at a high rate. The experiments confirmed that the proposed RL model showed a rapid convergence to the optimal policy which could minimize the vibration level with respect to the dynamic excitation disturbance. Results showed that the RL model had a similar performance as the conventional tuning method and suppressed the vibration level as much as 57% compared to the one without the controller. Also, the proposed RL algorithm was able to estimate the actual dynamics of the MRE TVA by learning from the environment. Thus, this study showed the feasibility of implementing a model-free RL model to realize an adaptive controller for applications based on highly nonlinear MRE.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Vibration Control and Rheological Fluids · Structural Engineering and Vibration Analysis · Elevator Systems and Control
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (53)
Show source-provided references
1. Liu · 201910.5772/intechopen.85083 ↗
2. Stiffness control of magnetorheological gels for adaptive tunable vibration absorber10.1088/1361-665X/26/1/015016 ↗
3. Suppressing harmonic vibrations of a miniature cryogenic cooler using an adaptive tunable vibration absorber based on magneto-rheological elastomers10.1063/1.3553198 ↗
4. Note: real time control of a tunable vibration absorber based on magnetorheological elastomer for suppressing tonal vibrations10.1063/1.4704455 ↗
5. Design and test of an adaptive vibration absorber based on magnetorheological elastomers and a hybrid electromagnet10.1177/1045389X12463461 ↗
6. Note: vibration suppression using tunable vibration absorber based on stiffness variable magneto-rheological gel10.1063/1.4933225 ↗
7. Development of an adaptive tuned vibration absorber with magnetorheological elastomer10.1088/0964-1726/15/5/N02 ↗
8. Experimental investigation of an adaptively tuned dynamic absorber incorporating magnetorheological elastomer with self-sensing property10.1007/s11340-016-0137-2 ↗
9. Designing an attachable and power-efficient all-in-one module of a tunable vibration absorber based on magnetorheological elastomer10.1088/1361-665X/aacdbd ↗
10. Multidisciplinary design optimization of a novel sandwich beam-based adaptive tuned vibration absorber featuring magnetorheological elastomer10.3390/ma13102261 ↗
11. A magneto-rheological elastomer vibration isolator for lightweight structures10.1007/s11012-019-00951-2 ↗
12. A novel bi-directional shear mode magneto-rheological elastomer vibration isolator10.1177/1045389X20942314 ↗
13. A real-time controllable electromagnetic vibration isolator based on magnetorheological elastomer with quasi-zero stiffness characteristic10.1088/1361-665X/ab2e44 ↗
14. Modeling and vibration control of a smart vibration isolation system based on magneto-sensitive rubber10.1088/1361-665X/ab1ab4 ↗
15. Two-way controllable magnetorheological elastomer mount for shock and vibration mitigation10.1088/1361-665X/ab4223 ↗
16. Feasibility study of an adaptive mount system based on magnetorheological elastomer using real-time hybrid simulation10.1177/1045389X18754347 ↗
17. Dynamic analysis of laminated composite sandwich beam containing carbon nanotubes reinforced magnetorheological elastomer10.1177/1099636220905253 ↗
18. Dynamic stability analysis of a sandwich beam with magnetorheological elastomer core subjected to a follower force10.1007/s00707-020-02735-2 ↗
19. A numerical-experimental dynamic analysis of composite sandwich beam with magnetorheological elastomer honeycomb core10.1016/j.compstruct.2018.10.041 ↗
20. Dynamic stability of the rotating carbon nanotube-reinforced adaptive sandwich beams with magnetorheological elastomer core10.1177/1099636219849414 ↗
21. Design of a stiffness variable flexible coupling using magnetorheological elastomer for torsional vibration reduction10.1177/1045389X19862378 ↗
22. A highly adjustable magnetorheological elastomer base isolator for applications of real-time adaptive control10.1088/0964-1726/22/9/095020 ↗
23. Development and characterization of a magnetorheological elastomer based adaptive seismic isolator10.1088/0964-1726/22/3/035005 ↗
24. Experimental realisation of the real-time controlled smart magnetorheological elastomer seismic isolation system with shake table10.1002/stc.2476 ↗
25. Magnetorheological elastomer base isolator for earthquake response mitigation on building structures: modeling and second-order sliding mode control10.12989/eas.2016.11.6.943 ↗
26. Balamonica · 2019 · 44510.1007/978-981-13-0365-4_38 ↗
27. A magnetorheological elastomer rail damper for wideband attenuation of rail noise and vibration10.1177/1045389X19873406 ↗
28. A hysteresis model for dynamic behaviour of magnetorheological elastomer base isolator10.1088/0964-1726/25/5/055029 ↗
29. Comparative investigation of phenomenological modeling for hysteresis responses of magnetorheological elastomer devices10.3390/ijms20133216 ↗
30. Temperature-dependent mechanical properties and model of magnetorheological elastomers10.1021/ie200386x ↗
31. Control of the damping properties of magnetorheological elastomers by using polycaprolactone as a temperature-controlling component10.1021/ie300317b ↗
32. Temperature-dependent dynamic mechanical properties of magnetorheological elastomers under magnetic field10.1016/j.jmmm.2014.08.012 ↗
33. Temperature dependent dynamic mechanical properties of magnetorheological elastomers: experiment and modeling10.1016/j.compstruct.2018.04.010 ↗
34. Experimental and theoretical study of temperature-dependent variable stiffness of magnetorheological elastomers10.3139/146.111590 ↗
35. Effect of temperature and relative humidity on friction and wear properties of silicone-based magnetorheological elastomer10.1080/10402004.2017.1306636 ↗
36. Experimental study of semi-active magnetorheological elastomer base isolation system using optimal neuro fuzzy logic control10.1016/j.ymssp.2018.10.001 ↗
37. Narx neural network modeling and robustness analysis of magnetorheological elastomer isolator10.1088/0964-1726/25/12/125019 ↗
38. Adaptive damping of a double-beam structure based on magnetorheological elastomer10.1155/2019/8526179 ↗
39. Modeling and semi-active fuzzy control of magnetorheological elastomer-based isolator for seismic response reduction10.1016/j.ymssp.2017.08.040 ↗
40. Modelling and control of a magneto-rheological elastomer for impact reduction10.15282/jmes.13.3.2019.04.0430 ↗
41. Fuzzy-neural network control for a magnetorheological elastomer vibration isolation system10.1088/1361-665X/ab874d ↗
42. Adaptive fuzzy control of a magnetorheological elastomer vibration isolation system with time-varying sinusoidal excitations10.1016/j.jsv.2019.05.046 ↗
43. Sutton · 2018
44. Simple statistical gradient-following algorithms for connectionist reinforcement learning10.1007/BF00992696 ↗
45. Asynchronous methods for deep reinforcement learning
46. Continuous control with deep reinforcement learning
47. Trust region policy optimization
48. Proximal policy optimization algorithms
49. Generalization in Reinforcement Learning: Successful Examples Using Sparse Coarse Coding10.5555/2998828.2998974 ↗
50. Q-learning10.1007/BF00992698 ↗
51. Playing atari with deep reinforcement learning
52. Investigations on response time of magnetorheological elastomer isolator for real-time control implementation10.1088/0964-1726/25/11/11LT04 ↗
53. Investigations on response time of magnetorheological elastomer under compression mode10.1088/1361-665X/aab63e ↗