Evaluation of Different Control Algorithms for Carbon Dioxide Removal with Membrane Oxygenators
Source abstract
Abstract
Membrane oxygenators are devices that benefit from automatic control. This is especially true for implantable membrane oxygenators—a class of wearable rehabilitation devices that show high potential for fast recovery after lung injury. We present a performance comparison for reference tracking of carbon dioxide partial pressure between three control algorithms—a classical proportional-integral (PI) controller, a modern non-linear model predictive controller, and a novel deep reinforcement learning controller. The results are based on simulation studies of an improved compartmental model of a membrane oxygenator. The compartmental model of the oxygenator was improved by decoupling the oxygen kinetics from the system and only using the oxygen saturation as an input to the model. Both the gas flow rate and blood flow rate were used as the manipulated variable of the controllers. All three controllers were able to track references satisfactorily, based on several performance metrics. The PI controller had the fastest response, with an average rise time and settling time of 1.18 s and 2.24 s and the lowest root mean squared error of 1.06 mmHg. The NMPC controller showed the lowest steady state error of 0.17 mmHg and reached the reference signal with less than 2% error in 90% of the cases within 15 s. The PI and RL reached the reference with less than 2% error in 84% and 50% of the cases, respectively, and showed a steady state error of 0.29 mmHg and 0.5 mmHg.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Mechanical Circulatory Support Devices · Respiratory Support and Mechanisms · Cardiac Arrest and Resuscitation
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institute of Engineering Design and Product Development, TU Wien, 1060 Vienna, Austria
Institute of Chemical, Environmental and Bioscience Engineering, TU Wien, 1060 Vienna, Austria
Funding
Austrian Research Promotion Agency
References (37)
Show source-provided references
1. Extra Corporeal Membrane Oxygenation (ECMO) review of a lifesaving technology
2. An extracorporeal carbon dioxide removal (ECCO 2 R) device operating at hemodialysis blood flow rates10.1186/s40635-017-0154-1 ↗
3. Mechanical ventilation during extra-corporeal membrane oxygenation: More questions than answers10.23736/S0375-9393.18.13204-4 ↗
4. Ficial, B., Vasques, F., Zhang, J., Whebell, S., Slattery, M., Lamas, T., Daly, K., and Camporota, N.A. (2021). Physiological basis of extracorporeal membrane oxygenation and extracorporeal carbon dioxide removal in respiratory failure. Membranes, 11.10.3390/membranes11030225 ↗
5. Polymeric hollow fiber membrane oxygenators as artificial lungs: A review10.1016/j.bej.2022.108340 ↗
6. The evolving role of the modern perfusionist: Insights from transesophageal echocardiography10.1177/0267659120944094 ↗
7. Einsatz der extrakorporalen Zirkulation (ECLS/ECMO) bei Herz- und Kreislaufversagen10.1007/s12181-021-00514-4 ↗
8. Techniques for avoiding neurologic injury during adult cardiac surgery10.1016/S1053-0770(96)80177-7 ↗
9. Simultaneous automatic control of oxygen and carbon dioxide blood gases during cardiopulmonary bypass10.1111/j.1525-1594.2009.00890.x ↗
10. Control for Carbon Dioxide Exchange Process in a Membrane Oxygenator Using Online Self-Tuning Fuzzy-PID Controller10.1016/j.bspc.2020.102300 ↗
11. Fractional-order control of a nonlinear time-delay system: Case study in oxygen regulation in the heart-lung machine10.1155/2012/478346 ↗
12. Development of a digital adaptive control system for PO2 regulation in a membrane oxygenator10.1016/0141-5425(92)90086-Z ↗
13. A mathematical model of carbon dioxide transfer in the placenta and its interaction with oxygen10.1152/ajplegacy.1973.224.2.283 ↗
14. Lukitsch, B., Ecker, P., Elenkov, M., Janeczek, C., Haddadi, B., Jordan, C., Krenn, C., Ulrich, R., Gfoehler, M., and Harasek, M. (2020). Computation of global and local mass transfer in hollow fiber membrane modules. Sustainability, 12.10.3390/su12062207 ↗
15. Velocity of CO2 exchange in blood10.1146/annurev.ph.50.030188.003205 ↗
16. A mathematical model for the gas transfer in an oxygenator10.1016/S1474-6670(17)33538-3 ↗
17. Misgeld, B.J.E. (2007). Automatic Control of the Heart-Lung Machine. [Ph.D. Thesis, Ruhr-Universität Bochum, Universitätsbibliothek].
18. Mathematical Modelling of Carbon Dioxide Exchange in Hollow Fiber Membrane Oxygenator10.1088/1757-899X/210/1/012003 ↗
19. The MATLAB ODE Suite10.1137/S1064827594276424 ↗
20. Suitable CO2 solubility models for determination of the CO2 removal performance of oxygenators10.3390/bioengineering8030033 ↗
21. Harasek, M., Elenkov, M., Lukitsch, B., Ecker, P., Janeczek, C., and Gfoehler, M. (2018, January 21–24). Design of Control Strategies for the CO2 Removal from Blood with an Intracorporeal Membrane Device. Proceedings of the 11th Biomedical Engineering International Conference (BMEiCON), Chiang Mai, Thailand.10.1109/BMEiCON.2018.8609947 ↗
22. Optimum settings for automatic controllers10.1115/1.2899060 ↗
23. Grüne, L., and Pannek, J. (2017). Nonlinear Model Predictive Control Theory and Algorithms, Springer.10.1007/978-3-319-46024-6 ↗
24. Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, The MIT Press. [2nd ed.].
25. Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., and Wierstra, D. (2015). Continuous control with deep reinforcement learning. arXiv.
26. Fujimoto, S., van Hoof, H., and Meger, D. (2015, January 10–15). Addressing Function Approximation Error in Actor-Critic Methods. Proceedings of the Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden.
27. An Introduction to Deep Reinforcement Learning
28. Q-learning10.1007/BF00992698 ↗
29. Dulac-Arnold, G., Mankowitz, D., and Hester, T. (2019). Challenges of Real-World Reinforcement Learning. arXiv.
30. A trust region method based on interior point techniques for nonlinear programming10.1007/PL00011391 ↗
31. An interior algorithm for nonlinear optimization that combines line search and trust region steps10.1007/s10107-004-0560-5 ↗
32. Rizvi, A.S.A., Pertzborn, A.J., and Lin, Z. (2021). Reinforcement Learning Based Optimal Tracking Control Under Unmeasurable Disturbances with Application to HVAC Systems. IEEE Trans. Neural Netw. Learn. Syst., 1–11.
33. Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., and Mané, D. (2016). Concrete Problems in AI Safety. arXiv.
34. Interior-point methods10.1016/S0377-0427(00)00433-7 ↗
35. Massive air embolism during cardiopulmonary bypass. Causes, prevention, and management10.1016/S0022-5223(19)37716-5 ↗
36. Van Hasselt, H., Doron, Y., Strub, F., Hessel, M., Sonnerat, N., and Modayil, J. (2018). Deep Reinforcement Learning and the Deadly Triad. arXiv.
37. Non-parametric dynamical estimation of blood flow rate, pressure difference and viscosity for a miniaturized blood pump10.1177/03913988211006720 ↗