journal article·2022-01-19Open access

Analyzing Dynamic Operational Conditions of Limb Prosthetic Sockets with a Mechatronics-Twin Framework

Dejiu Chen, Peng Su, Suranjan Ottikkutti, Panagiotis Vartholomeos, Kaveh Nazem Tahmasebi, Michalis Karamousadakis

Applied Sciences· Volume 12· Issue 3

Abstract

Lower limb prostheses offer a solution to restore the ambulation and self-esteem of amputees. One key component is the prosthetic socket that serves as the interface between prosthetic device and amputee stump and thereby has a wide range of impacts on efficient fitting, appropriate load transmission, operational stability, and control. For the design and optimization of a prosthetic socket, an understanding of the actual intra-socket operational conditions becomes therefore necessary. This is however a difficult task due to the inherent complexity and restricted observability of socket operation. In this study, an innovative mechatronics-twin framework that integrates advanced biomechanical models and simulations with physical prototyping and dynamic operation testing for effective exploration of operational behaviors of prosthetic sockets with amputees is proposed. Within this framework, a specific Stewart manipulator is developed to enable dynamic operation testing, in particular for a well-managed generation of dynamic intra-socket loads and behaviors that are otherwise difficult to observe or realize with the real amputees. A combination of deep learning and Bayesian Inference algorithms is then employed for analyzing the intra-socket load conditions and revealing possible anomalous.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Muscle activation and electromyography studies · Prosthetics and Rehabilitation Robotics · Robot Manipulation and Learning

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Machine Design, KTH Royal Institute of Technology, 100 44 Stockholm, Sweden

Department of Computer Science and Biomedical Informatics, University of Thessaly, 351 31 Lamia, Greece

TWI Hellas, 152 32 Halandri, Greece

Funding

European Union’s Horizon 2020 research and innovation programme

References (70)

Show source-provided references
1. The O&P EDGE and the Amputee Coalition (2021). Amputee Patient Comfort and Compliance. inMotion, 21, 5.
2. Gait phases recognition from accelerations and ground reaction forces: Application of neural networks
3. Sockets for limb prostheses: A review of existing technologies and open challenges10.1109/TBME.2017.2775100 ↗
4. Quantifying interface pressures in below-knee-amputee sockets
5. A review of prosthetic interface stress investigations
6. Validation of shear wave elastography in skeletal muscle10.1016/j.jbiomech.2013.07.033 ↗
7. Inverse finite-element modeling for tissue parameter identification using a rolling indentation probe10.1007/s11517-013-1118-6 ↗
8. Introduction to automata theory, languages, and computation10.1145/568438.568455 ↗
9. Gagniuc, P.A. (2017). Markov Chains: From Theory to Implementation and Experimentation, John Wiley & Sons.10.1002/9781119387596 ↗
10. Geng, Y., Yang, P., Xu, X., and Chen, L. (2012, January 23–25). Design and simulation of active transfemoral prosthesis. Proceedings of the 24th Chinese Control and Decision Conference (CCDC), Taiyuan, China.
11. Stump-socket interface pressure as an aid to socket design in prostheses for trans-femoral amputees—A preliminary study10.1243/0954411971534287 ↗
12. Concepts of pressure in an ischial containment socket: Measurement10.1097/00008526-200501000-00003 ↗
13. Transfemoral interfaces with vacuum assisted suspension comparison of gait, balance, and subjective analysis: Ischial containment versus brimless10.1016/j.gaitpost.2014.04.206 ↗
14. A pressure and shear sensor system for stress measurement at lower limb residuum/socket interface10.1016/j.medengphy.2016.04.007 ↗
15. State-of-the-art research in lower-limb prosthetic biomechanics
16. Computer-aided socket design for trans-femoral amputees10.3109/03093649309164378 ↗
17. A digital patient for computer-aided prosthesis design10.1098/rsfs.2012.0082 ↗
18. Prosthesis socket design through shape optimization10.3722/cadaps.2013.863-876 ↗
19. An efficient modelling-simulation-analysis workflow to investigate stump-socket interaction using patient-specific, three-dimensional, continuum-mechanical, finite element residual limb models10.3389/fbioe.2018.00126 ↗
20. A personalised prosthetic liner with embedded sensor technology: A case study
21. Examination of the performance characteristics of velostat as an in-socket pressure sensor10.1109/JSEN.2020.2978431 ↗
22. Jamaludin, M.S. (2021, November 23). Dynamic Analysis of Transfemoral Prosthesis Function Using Finite Element Method. Available online: https://www.shibaura-it.ac.jp/albums/abm.php?d=1415&f=abm00010339.pdf&n=9.Thesis_Abstract_Syahmi.pdf.
23. Influence of gait cycle loads on stress distribution at the residual limb/socket interface of transfemoral amputees: A finite element analysis10.1038/s41598-020-61915-1 ↗
24. Fast soft tissue deformation and stump-socket interaction toward a computer-aided design system for lower limb prostheses10.1016/j.irbm.2020.02.003 ↗
25. Boschert, S., and Rosen, R. (2016). Digital twin—The Simulation Aspect. Mechatronic Futures, Springer.10.1007/978-3-319-32156-1_5 ↗
26. Dejke, V., Eng, M.P., Brinkfeldt, K., Charnley, J., Lussey, D., and Lussey, C. (2021). Development of Prototype Low-Cost QTSS™ Wearable Flexible More Enviro-Friendly Pressure, Shear, and Friction Sensors for Dynamic Prosthetic Fit Monitoring. Sensors, 21.10.3390/s21113764 ↗
27. Bao, M.H. (2000). Micro Mechanical Transducers: Pressure Sensors, Accelerometers and Gyroscopes, Elsevier.
28. Dabling, J.G., Filatov, A., and Wheeler, J.W. (September, January 28). Static and cyclic performance evaluation of sensors for human interface pressure measurement. Proceedings of the 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, USA.10.1109/EMBC.2012.6345896 ↗
29. Hollinger, A., and Wanderley, M.M. (2006, January 4–8). Evaluation of commercial force-sensing resistors. Proceedings of the International Conference on New Interfaces for Musical Expression, Paris, France.
30. Calibration problems encountered while monitoring stump/socket interface pressures with force sensing resistors: Techniques adopted to minimise inaccuracies10.3109/03093649709164552 ↗
31. Scientific validation of two commercial pressure sensor systems for prosthetic socket fit10.1080/03093640008726523 ↗
32. Khodasevych, I., Parmar, S., and Troynikov, O. (2017). Flexible sensors for pressure therapy: Effect of substrate curvature and stiffness on sensor performance. Sensors, 17.10.3390/s17102399 ↗
33. Elfes, A. (1990, January 27–29). A stochastic spatial representation for Active Robot Perception. Proceedings of the Sixth Conference on Uncertainty and Al, AAAI, Cambridge, MA, USA.
34. Bessiere, P., Dedieu, E., and Mazer, E. (1994, January 7–9). Representing Robot/Environment interactions using probabilities: The “Beam in the Bin” experiment. Proceedings of the PerAc’94, from Perception to Action, Lausanne, Switzerland.
35. Burgard, W., Fox, D., Hennig, D., and Schmidt, T. (1996, January 4–8). Estimating the absolute position of a mobile robot using position probability grids. Proceedings of the National Conference on Artificial Intelligence, Portland, OR, USA.
36. Learning occupancy grid maps with forward sensor models10.1023/A:1025584807625 ↗
37. Muller, J., Rottmann, A., Reindl, L.M., and Burgard, W. (2009, January 12–17). A probabilistic sonar sensor model for robust localization of a small-size blimp in indoor environments using a particle filter. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.10.1109/ROBOT.2009.5152283 ↗
38. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion
39. Hinton, G.E., Krizhevsky, A., and Wang, S.D. (2021, January 14–17). Transforming auto-encoders. Proceedings of the International Conference on Artificial Neural Networks, Bratislava, Slovakia.
40. Thirukovalluru, R., Dixit, S., Sevakula, R.K., Verma, N.K., and Salour, A. (2016, January 20–22). Generating feature sets for fault diagnosis using denoising stacked auto-encoder. Proceedings of the 2016 IEEE International Conference on Prognostics and Health Management (ICPHM), Ottawa, ON, Canada.10.1109/ICPHM.2016.7542865 ↗
41. The elements of statistical learning: Data mining, inference and prediction10.1007/BF02985802 ↗
42. Brockwell, P.J., and Davis, R.A. (2009). Time Series: Theory and Methods, Springer Science & Business Media.
43. Rumelhart, D.E., McClelland, J.L. (1986). Learning Internal Representations by Error Propagation, MIT Press. Parallel Distributed Processing: Explorations in the Microstructure of Cognition.10.7551/mitpress/5236.001.0001 ↗
44. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
45. Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014). Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv.10.3115/v1/D14-1179 ↗
46. Anzai, Y. (2012). Pattern Recognition and Machine Learning, Elsevier.
47. Liu, D.X., Wu, X., Du, W., Wang, C., and Xu, T. (2016). Gait phase recognition for lower-limb exoskeleton with only joint angular sensors. Sensors, 16.10.3390/s16101579 ↗
48. Cross-subject and cross-modal transfer for generalized abnormal gait pattern recognition10.1109/TNNLS.2020.3009448 ↗
49. State-of-the-art review on Bayesian Inference in structural system identification and damage assessment10.1177/1369433218811540 ↗
50. Jelinek, F. (1997). Statistical Methods for Speech Recognition, MIT Press.
51. Hidden Markov models for speech recognition10.1080/00401706.1991.10484833 ↗
52. Manning, C., and Schutze, H. (1999). Foundations of Statistical Natural Language Processing, MIT Press.
53. Script recognition using hidden Markov models10.1109/ICASSP.1986.1168951 ↗
54. Hidden Markov models in computational biology: Applications to protein modeling10.1006/jmbi.1994.1104 ↗
55. Baldi, P., Brunak, S., and Bach, F. (2001). Bioinformatics: The Machine Learning Approach, MIT Press.
56. Rodriguez, A., Bourne, D., Mason, M., Rossano, G.F., and Wang, J. (2010, January 21–24). Failure detection in assembly: Force signature analysis. Proceedings of the 2010 IEEE International Conference on Automation Science and Engineering, Toronto, ON, Canada.10.1109/COASE.2010.5584452 ↗
57. Hornung, R., Urbanek, H., Klodmann, J., Osendorfer, C., and Van Der Smagt, P. (2014, January 14–18). Model-free robot anomaly detection. Proceedings of the 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA.10.1109/IROS.2014.6943078 ↗
58. Support vector machines in engineering: An overview10.1002/widm.1125 ↗
59. (2021, November 23). Statistical Classification. Available online: https://en.wikipedia.org/wiki/Statistical_classification.
60. (2021, April 16). OpenSim. Available online: https://simtk.org/projects/opensimlatest.
61. (2021, April 16). Ansys. Available online: https://www.ansys.com.
62. Mohamed, A. (2018). Modeling and Simulation of Transfemoral Amputee Gait. [Ph.D. Thesis, University of New Brunswick].
63. Schmidt, R., and Singh, K. (2010). Meshmixer: An interface for rapid mesh composition. ACM SIGGRAPH 2010 Talks, Association for Computing Machinery.10.1145/1837026.1837034 ↗
64. Zanetti, L.R. (2021, November 23). Lumped Parameter and Modal Models to Simulate Ground Reaction Forces Due to Running. Available online: https://repositorio.unesp.br/handle/11449/202681.
65. Jakobovic, D., and Jelenkovic, L. (2002). The Forward and Inverse Kinematics Problems for Stewart Parallel Mechanisms, University of Zagreb.
66. Bunke, H., and Caelli, T.M. (2001). Hidden Markov Models: Applications in Computer Vision, World Scientific.10.1142/9789812797605 ↗
67. Fasshauer, G.E. (2007). Meshfree Approximation Methods with MATLAB, World Scientific.10.1142/6437 ↗
68. Larson, K. (2016). Can You Estimate Modulus from Durometer Hardness for Silicones, Dow Corning Corporation.
69. (2021, April 16). HMM. Available online: https://hmmlearn.readthedocs.io/en/latest.
70. Buitinck, L., Louppe, G., Blondel, M., Pedregosa, F., Mueller, A., Grisel, O., Niculae, V., Prettenhofer, P., Gramfort, A., and Grobler, J. (2013). API design for machine learning software: Experiences from the scikit-learn project. arXiv.