Development of a Control Algorithm for a Semi-Active Mid-Story Isolation System Using Reinforcement Learning
Source abstract
Abstract
The semi-active control system is widely used to reduce the seismic response of building structures. Its control performance mainly depends on the applied control algorithms. Various semi-active control algorithms have been developed to date. Recently, machine learning has been applied to various engineering fields and provided successful results. Because reinforcement learning (RL) has shown good performance for real-time decision-making problems, structural control engineers have become interested in RL. In this study, RL was applied to the development of a semi-active control algorithm. Among various RL methods, a Deep Q-network (DQN) was selected because of its successful application to many control problems. A sample building structure was constructed by using a semi-active mid-story isolation system (SMIS) with a magnetorheological damper. Artificial ground motions were generated for numerical simulation. In this study, the sample building structure and seismic excitation were used to make the RL environment. The reward of RL was designed to reduce the peak story drift and the isolation story drift. Skyhook and groundhook control algorithms were applied for comparative study. Based on numerical results, this paper shows that the proposed control algorithm can effectively reduce the seismic responses of building structures with a SMIS.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Vibration Control and Rheological Fluids · Elevator Systems and Control · Seismic Performance and Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Division of Architecture, Sunmoon University, Asan-si 31460, Republic of Korea
Civil and Environmental Engineering Department, California State University, Fullerton, CA 92831, USA
Funding
National Research Foundation of Korea
References (37)
Show source-provided references
1. Reliability assessment of MR fluid dampers in passive and semi-active seismic control of structures10.1016/j.probengmech.2020.103114 ↗
2. Nonlinear structural control using integrated DDA/ISMP and semi-active tuned mass damper10.1016/j.engstruct.2018.12.059 ↗
3. Semi-active vibration control of smart isolated highway bridge structures using replicator dynamics10.1016/j.engstruct.2019.02.031 ↗
4. Shih, M.H., and Sung, W.P. (2021). Seismic resistance and parametric study of building under control of impulsive semi-active mass damper. Appl. Sci., 11.10.3390/app11062468 ↗
5. Seismic performance improvement of base-isolated structures using a semi-active tuned mass damper10.1016/j.engstruct.2022.114963 ↗
6. Seismic collapse probability and life cycle cost assessment of isolated structures subjected to pounding with smart hybrid isolation system using a modified fuzzy based controller10.1016/j.istruc.2022.07.085 ↗
7. An adaptive control algorithm for smart base isolation systems based on seismic early warning system10.1016/j.istruc.2021.01.034 ↗
8. Emotional learning based adaptive control algorithm for semi-active seismic control of structures10.1016/j.matpr.2022.04.714 ↗
9. Semi-active control strategies for MR dampers: A comparative study10.1061/(ASCE)0733-9399(2000)126:8(795) ↗
10. A comparative study of semi-active control strategies for base isolated buildings10.1007/s11803-015-0039-9 ↗
11. Application of semi-active control strategies for seismic protection of buildings with MR dampers10.1016/j.engstruct.2010.05.023 ↗
12. Reinforcement learning for control: Performance, stability, and deep approximators10.1016/j.arcontrol.2018.09.005 ↗
13. Continuous action reinforcement learning applied to vehicle suspension control10.1016/S0957-4158(97)00003-2 ↗
14. Reinforcement learning for structural control10.1061/(ASCE)0887-3801(2008)22:2(133) ↗
15. Reinforcement learning in robotics: A survey10.1177/0278364913495721 ↗
16. Eshkevari, S.S., Eshkevari, S.S., Sen, D., and Pakzad, S.N. (2021). RL-Controller: A reinforcement learning framework for active structural control. arXiv.
17. Online control of an active seismic system via reinforcement learning10.1002/stc.2298 ↗
18. Deep reinforcement learning of semi-active suspension controller for vehicle ride comfort10.1109/TVT.2022.3207510 ↗
19. Semi-active suspension control based on deep reinforcement learning10.1109/ACCESS.2020.2964116 ↗
20. Sueoka, T., Torii, S., and Tsuneki, Y. (2004, January 1–6). The application of response control design using middle-story isolation system to high-rise building. Proceedings of the 13th World Conference on Earthquake Engineering, Vancouver, BC, Canada.
21. Design of fuzzy logic controller for smart base isolation system using genetic algorithm10.1016/j.engstruct.2005.07.006 ↗
22. Human-level control through deep reinforcement learning10.1038/nature14236 ↗
23. (2022, September 28). Introduction to RL and Deep Q Networks. Available online: https://www.tensorflow.org/agents/tutorials/0_intro_rl.
24. General theory of skyhook control and its application to semi-active suspension control strategy design10.1109/ACCESS.2019.2930567 ↗
25. (2022, November 11). Deep Learning vs. Machine Learning—What’s the Difference?. Available online: https://levity.ai/blog/difference-machine-learning-deep-learning/.
26. (2022, November 11). Different Types of Learning in Machine Learning. Available online: https://www.machinelearningmastery.com/types-of-learning-in-machine-learning/.
27. (2022, November 30). Deep Q-Network (DQN)-II. Available online: https://www.towardsdatascience.com/deep-q-network-dqn-ii-b6bf911b6b2c/.
28. (2022, November 30). How does the Bellman equation work in Deep RL?. Available online: https://towardsdatascience.com/how-the-bellman-equation-works-in-deep-reinforcement-learning-5301fe41b25a/.
29. System identification of degrading hysteretic restoring forces10.1061/(ASCE)0733-9399(1988)114:5(833) ↗
30. Experimental verification of multi-input seismic control strategies for smart dampers10.1061/(ASCE)0733-9399(2001)127:11(1152) ↗
31. Fractional Tajimi–Kanai model for simulating earthquake ground motion10.1007/s10518-014-9615-z ↗
32. “Smart” base isolation systems10.1061/(ASCE)0733-9399(2002)128:10(1088) ↗
33. GA-fuzzy control of smart base isolated benchmark building using supervisory control technique10.1016/j.advengsoft.2006.10.004 ↗
34. (2022, December 07). How to Choose an Activation Function for Deep Learning. Available online: https://machinelearningmastery.com/choose-an-activation-function-for-deep-learning/.
35. (2022, December 07). Epsilon-Greedy Algorithm in Reinforcement Learning. Available online: https://www.geeksforgeeks.org/epsilon-greedy-algorithm-in-reinforcement-learning/.
36. Use of semi-active tuned mass dampers for vibration control of force-excited structures10.12989/sem.2001.11.4.341 ↗
37. In search of suitable control methods for semi-active tuned vibration absorbers10.1177/1077546304032020 ↗