journal article·2023-01-09Open access

A Convolutional Neural Network-Based Broad Incremental Learning Filter for Attenuating Physiological Tremors in Telerobot Systems

Guanyu Lai, Weizhen Liu, Weijun Yang, Yun Zhang

Applied Sciences· Volume 13· Issue 2

Abstract

While master-slave teleoperated robotic systems have extensive applications in practice, the physiological tremors can easily affect the control accuracy and even destroy the stability of the closed-loop control systems during operation. Hence, the development of some effective approaches for counteracting physiological tremors is of both theoretical and practical importance. In this paper, a broad learning network-based filter integrating a deep learning network and modified incremental learning algorithms is proposed to reconstruct and compensate for tremor signals. To strengthen the recognition of correlations between different moments, the lateral connectivity structure is adopted to obtain multi-scale feature maps. Each feature window is obtained from multi-scale feature maps generated by the convolutional neural network, which has an advantage that makes the feature nodes fuse the feature information of long time series and short time series by the lateral connection. The broad learning network is a unique construction, which only needs to obtain the input and the output to conveniently calculate the connection weights by the pseudo-inverse without involving backpropagation. It is known that the relation between the data X and the label Y can be represented as XW=Y, and the solution W can be obtained by the pseudo-inverse W=X+Y. In addition, to guarantee the ill-posed problem, a ridge regression algorithm is used for the pseudo-inverse calculation. The effectiveness of our raised network architecture is illustrated by comparative simulation and experiment results.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: EEG and Brain-Computer Interfaces · Machine Learning and ELM · Neuroscience and Neural Engineering

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Automation, Guangdong University of Technology, Guangzhou 510006, China

School of Mechanical and Electrical Engineering, Guangzhou City Polytechnic, Guangzhou 510405, China

Funding

the Tertiary Education Scientific research project of Guangzhou Municipal Education Bureau · the Science and Technology Program of Guangzhou, China

References (38)

Show source-provided references
1. Individualisation of Inflight Catering Meals—An Automation Concept for Integrating Pre-Ordered Meals during the Flight for All Passengers10.3390/aerospace9110736 ↗
2. Hybrid modeling and analysis method for dynamic coupling of space robots10.1109/TAES.2015.140752 ↗
3. Medical and Health-Care Robotics10.1109/MRA.2010.937861 ↗
4. Passenger Acceptability of Teleoperation in Railways10.3390/futuretransp2040053 ↗
5. Mehrdad, S., Liu, F., Pham, M.T., Lelevé, A., and Atashzar, S.F. (2021). Review of Advanced Medical Telerobots. Appl. Sci., 11.10.3390/app11010209 ↗
6. Ehrampoosh, A., Shirinzadeh, B., Pinskier, J., Smith, J., Moshinsky, R., and Zhong, Y. (2022). A Force-Feedback Methodology for Teleoperated Suturing Task in Robotic-Assisted Minimally Invasive Surgery. Sensors, 22.10.3390/s22207829 ↗
7. Adaptive fuzzy wavelet neural network filter for hand tremor canceling in microsurgery10.1016/j.asoc.2011.05.027 ↗
8. A three-domain fuzzy wavelet network filter using fuzzy PSO for robotic assisted minimally invasive surgery10.1016/j.knosys.2014.03.025 ↗
9. Multistep Prediction of Physiological Tremor Based on Machine Learning for Robotics Assisted Microsurgery10.1109/TCYB.2014.2381495 ↗
10. Drift-Free Position Estimation of Periodic or Quasi-Periodic Motion Using Inertial Sensors10.3390/s110605931 ↗
11. A Bimodal Detection-Based Tremor Suppression System for Vascular Interventional Surgery Robots10.1109/TIM.2022.3218574 ↗
12. Sun, Z., Guo, J., Guo, S., and Song, Y. (2022, January 7–10). Study on A Novel Strategy for Eliminating Tremor in Vascular Interventional Robot. Proceedings of the 2022 IEEE International Conference on Mechatronics and Automation (ICMA), Guilin, China.10.1109/ICMA54519.2022.9856196 ↗
13. Quaternion broad learning system: A novel multi-dimensional filter for estimation and elimination tremor in teleoperation10.1016/j.neucom.2019.10.059 ↗
14. Broad learning extreme learning machine for forecasting and eliminating tremors in teleoperation10.1016/j.asoc.2021.107863 ↗
15. Hilbert–Huang-Based Tremor Removal to Assess Postural Properties From Accelerometers10.1109/TBME.2011.2116017 ↗
16. Tatinati, S., Veluvolu, K.C., and Ang, W.T. (2011, January 26–29). Autoregressive model with Kalman filter for estimation of physiological tremor in surgical robotic applications. Proceedings of the 2011 11th International Conference on Control, Automation and Systems, Gyeonggi-do, Republic of Korea.
17. Optimal digital filtering for tremor suppression10.1109/10.841338 ↗
18. Modeling and canceling tremor in human-machine interfaces10.1109/51.499755 ↗
19. Wang, Y., and Veluvolu, K.C. (2012, January 18–20). Time-frequency decomposition of band-limited signals with BMFLC and Kalman filter. Proceedings of the 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA), Singapore.10.1109/ICIEA.2012.6360794 ↗
20. Physiological Tremor Estimation With Autoregressive (AR) Model and Kalman Filter for Robotics Applications10.1109/JSEN.2013.2271737 ↗
21. Multistep Prediction of Physiological Tremor for Surgical Robotics Applications10.1109/TBME.2013.2264546 ↗
22. Ghassab, V.K., Mohammadi, A., Atashzar, S.F., and Patel, R.V. (2017, January 14–16). Dynamic estimation strategy for E-BMFLC filters in analyzing pathological hand tremors. Proceedings of the 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP), Montreal, QC, Canada.10.1109/GlobalSIP.2017.8308681 ↗
23. Personalized Variable Gain Control with Tremor Attenuation for Robot Teleoperation10.1109/TSMC.2017.2694020 ↗
24. Tatinati, S., Wang, Y., Shafiq, G., and Veluvolu, K.C. (2013, January 3–7). Online LS-SVM based multi-step prediction of physiological tremor for surgical robotics. Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan.10.1109/EMBC.2013.6610930 ↗
25. A time-sequence-based fuzzy support vector machine adaptive filter for tremor cancelling for microsurgery10.1080/00207721.2013.821718 ↗
26. Real-Time Voluntary Motion Prediction and Parkinson’s Tremor Reduction Using Deep Neural Networks10.1109/TNSRE.2021.3097007 ↗
27. Zhang, L., Guo, S., and Yang, C. (2021, January 8–11). Prediction of Physiological Tremor Based on Deep Learning for Vascular Interventional Surgery Robot. Proceedings of the 2021 IEEE International Conference on Mechatronics and Automation (ICMA), Takamatsu, Japan.10.1109/ICMA52036.2021.9512713 ↗
28. Broad Learning System: An Effective and Efficient Incremental Learning System without the Need for Deep Architecture10.1109/TNNLS.2017.2716952 ↗
29. Universal Approximation Capability of Broad Learning System and Its Structural Variations10.1109/TNNLS.2018.2866622 ↗
30. Liu, W., Lai, G., and Liu, A. (2021, January 22–24). Tremor Attenuation For Robot Teleoperation By A Broad Learning System-Based Approach. Proceedings of the 2021 China Automation Congress (CAC), Beijing, China.10.1109/CAC53003.2021.9727960 ↗
31. Veluvolu, K.C., Tan, U.X., Latt, W.T., Shee, C.Y., and Ang, W.T. (2009, January 22–25). Adaptive filtering of physiological tremor for real-time compensation. Proceedings of the 2008 IEEE International Conference on Robotics and Biomimetics, Bangkok, Thailand.10.1109/ROBIO.2009.4913057 ↗
32. A Quaternion Weighted Fourier Linear Combiner for Modeling Physiological Tremor10.1109/TBME.2016.2530564 ↗
33. Adhikari, K., Tatinati, S., Veluvolu, K.C., and Nazarpour, K. (2015, January 22–24). Modeling 3D tremor signals with a quaternion weighted Fourier Linear Combiner. Proceedings of the 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER), Montpellier, France.10.1109/NER.2015.7146744 ↗
34. Teleoperation Control Based on Combination of Wave Variable and Neural Networks10.1109/TSMC.2016.2615061 ↗
35. Design and Instrumentation of Force Feedback in Telerobotics10.1109/TIM.2008.2005858 ↗
36. Ju, Z., Yang, C., Li, Z., Cheng, L., and Ma, H. (2014, January 28–29). Teleoperation of humanoid baxter robot using haptic feedback. Proceedings of the International Conference on Multisensor Fusion & Information Integration for Intelligent Systems, Beijing, China.10.1109/MFI.2014.6997721 ↗
37. Ridge regression: Biased estimation for nonorthogonal problems
38. Focal Loss for Dense Object Detection10.1109/TPAMI.2018.2858826 ↗