journal article·2024-12-10Open access

A Smart Motor Rehabilitation System Based on the Internet of Things and Humanoid Robotics

Yasamin Moghbelan, Alfonso Esposito, Ivan Zyrianoff, Giulia Spaletta, Stefano Borgo, Claudio Masolo, Fabiana Ballarin, Valeria Seidita, Roberto Toni, Fulvio Barbaro, Giusy Di Conza, Francesca Pia Quartulli, Marco Di Felice

Applied Sciences· Volume 14· Issue 24

Abstract

The Internet of Things (IoT) is gaining increasing attention in healthcare due to its potential to enable continuous monitoring of patients, both at home and in controlled medical environments. In this paper, we explore the integration of IoT with human-robotics in the context of motor rehabilitation for groups of patients performing moderate physical routines, focused on balance, stretching, and posture. Specifically, we propose the I-TROPHYTS framework, which introduces a step-change in motor rehabilitation by advancing towards more sustainable medical services and personalized diagnostics. Our framework leverages wearable sensors to monitor patients’ vital signs and edge computing to detect and estimate motor routines. In addition, it incorporates a humanoid robot that mimics the actions of a physiotherapist, adapting motor routines in real-time based on the patient’s condition. All data from physiotherapy sessions are modeled using an ontology, enabling automatic reasoning and planning of robot actions. In this paper, we present the architecture of the proposed framework, which spans four layers, and discuss its enabling components. Furthermore, we detail the current deployment of the IoT system for patient monitoring and automatic identification of motor routines via Machine Learning techniques. Our experimental results, collected from a group of volunteers performing balance and stretching exercises, demonstrate that we can achieve nearly 100% accuracy in distinguishing between shoulder abduction and shoulder flexion, using Inertial Measurement Unit data from wearable IoT devices placed on the wrist and elbow of the test subjects.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robotics and Automated Systems · Context-Aware Activity Recognition Systems · Gaze Tracking and Assistive Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science and Engineering, University of Bologna, 40126 Bologna, Italy

Department of Statistical Sciences, University of Bologna, 40126 Bologna, Italy

Laboratory for Applied Ontology (LOA), ISTC-CNR, 38123 Trento, Italy

Department of Engineering, University of Palermo, 90133 Palermo, Italy

CNR-ISSMC, 48018 Faenza, Italy

Endocrinology—TMC/TUSM, Boston, MA 02116, USA

Center for AI in Medicine and Odontostomatology, Centro Medico Galliera, San Venanzio di Galliera, 40015 Bologna, Italy

Re.Mo.Bio.S Lab, DIMEC, University of Parma, 43121 Parma, Italy

Funding

PRIN 2022 project I-TROPHYTS · PRIN PNRR 2022 project SORTT

References (52)

Show source-provided references
1. Eurostat (2024, December 01). Ageing Europe—Statistics on Population Developments. Available online: https://ec.europa.eu/eurostat/statistics-explained/index.php?title=Ageing_Europe_-_statistics_on_population_developments.
2. Physical Activity/Exercise and Diabetes: A Position Statement of the American Diabetes Association10.2337/dc16-1728 ↗
3. Movement Disorders in People With Parkinson Disease: A Model for Physical Therapy10.1093/ptj/80.6.578 ↗
4. Usage of Narrowband Internet of Things in Smart Medicine and Construction of Robotic Rehabilitation System10.1109/ACCESS.2021.3136347 ↗
5. IoT-based vital sign monitoring: A literature review10.1016/j.smhl.2024.100462 ↗
6. Early Prediction of Poststroke Rehabilitation Outcomes Using Wearable Sensors10.1093/ptj/pzad183 ↗
7. A Survey of Wearable Sensors and Machine Learning Algorithms for Automated Stroke Rehabilitation10.1109/ACCESS.2024.3373910 ↗
8. Bravi, R., Caputo, S., Jayousi, S., Martinelli, A., Biotti, L., Nannini, I., Cohen, E., Quarta, E., Grasso, S., and Lucchesi, G. (2021). An Inertial Measurement Unit-Based Wireless System for Shoulder Motion Assessment in Patients with Cervical Spinal Cord Injury: A Validation Pilot Study in a Clinical Setting. Sensors, 21.10.3390/s21041057 ↗
9. Tak, I., Wiertz, W., Barendrecht, M., and Langhout, R. (2020). Validity of a New 3-D Motion Analysis Tool for the Assessment of Knee, Hip and Spine Joint Angles during the Single Leg Squat. Sensors, 20.10.3390/s20164539 ↗
10. IoT Architecture for Smart Control of an Exoskeleton Robot in Rehabilitation by Using a Natural User Interface Based on Gestures10.1007/s10916-020-01602-w ↗
11. AI and IoT-Enabled Smart Exoskeleton System for Rehabilitation of Paralyzed People in Connected Communities10.1109/ACCESS.2021.3083093 ↗
12. Kanungo, J., Mane, D., Mahajan, P., and Salian, S. (2023, January 23–24). Recognizing Physiotherapy Exercises using Machine Learning. Proceedings of the 2023 Second International Conference on Trends in Electrical, Electronics, and Computer Engineering (TEECCON), Bangalore, India.10.1109/TEECCON59234.2023.10335844 ↗
13. Computer Vision Based on a Modular Neural Network for Automatic Assessment of Physical Therapy Rehabilitation Activities10.1109/TNSRE.2022.3226459 ↗
14. An, J., Kim, J., Lai, E.C., and Lee, B.C. (2020, January 20–24). Effects of a Smartphone-Based Wearable Telerehabilitation System for In-Home Dynamic Weight-Shifting Balance Exercises by Individuals with Parkinson’s Disease. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada.10.1109/EMBC44109.2020.9175967 ↗
15. Edge Computing with Artificial Intelligence: A Machine Learning Perspective10.1145/3555802 ↗
16. CACHE-IT: A distributed architecture for proactive edge caching in heterogeneous IoT scenarios10.1016/j.adhoc.2024.103413 ↗
17. Riek, L.D., Rabinowitch, T.C., Chakrabarti, B., and Robinson, P. (2009, January 9–13). How anthropomorphism affects empathy toward robots. Proceedings of the 4th ACM/IEEE Conference on Human Robot Interaction, La Jolla, CA, USA.10.1145/1514095.1514158 ↗
18. Toward Multimodal Human–Robot Interaction to Enhance Active Participation of Users in Gait Rehabilitation10.1109/TNSRE.2017.2703586 ↗
19. Basmaji, T., Yaghi, M., Zia, H., Qamhieh, L., Abueida, D., Abueida, M., and Ghazal, M. (2022, January 15–16). Posture Detection Framework Using the Internet of Wearable Things. Proceedings of the 2022 2nd International Conference on Computing and Machine Intelligence (ICMI), Istanbul, Turkey.10.1109/ICMI55296.2022.9873656 ↗
20. Thakur, S., Das, S., and Bhaumik, S. (2020, January 7–9). A Smart-Band Operated Wrist Rehabilitation Robot. Proceedings of the 2020 IEEE Applied Signal Processing Conference (ASPCON), Kolkata, India.10.1109/ASPCON49795.2020.9276666 ↗
21. SR-POSE: A Novel Non-Contact Real-Time Rehabilitation Evaluation Method Using Lightweight Technology10.1109/TNSRE.2023.3324960 ↗
22. A Survey on Yogic Posture Recognition10.1109/ACCESS.2023.3240769 ↗
23. Lee, B., Xu, J., and Howard, A. (December, January 27). Does appearance matter? Validating engagement in therapy protocols with socially interactive humanoid robots. Proceedings of the 2017 IEEE Symposium Series on Computational Intelligence (SSCI), Honolulu, HI, USA.10.1109/SSCI.2017.8285303 ↗
24. Artificial intelligence, bias and clinical safety10.1136/bmjqs-2018-008370 ↗
25. Lessons learnt about Autonomous AI: Finding a safe, efficacious and ethical path through the development process10.1016/j.ajo.2020.02.022 ↗
26. Berges, I., Antón, D., Bermúdez, J., Goñi, A., and Illarramendi, A. (2016). TrhOnt: Building an ontology to assist rehabilitation processes. J. Biomed Semant., 7.10.1186/s13326-016-0104-y ↗
27. Overview and evaluation of bluetooth low energy: An emerging low-power wireless technology10.3390/s120911734 ↗
28. Morris, D., Saponas, T.S., Guillory, A., and Kelner, I. (May, January 26). RecoFit: Using a wearable sensor to find, recognize, and count repetitive exercises. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, ON, Canada.
29. A review of machine learning-based human activity recognition for diverse applications10.1007/s00521-022-07665-9 ↗
30. A Survey of Machine Learning and Meta-heuristics Approaches for Sensor-based Human Activity Recognition Systems10.1007/s12652-022-03870-5 ↗
31. Feed-forward neural networks10.1109/45.329294 ↗
32. Decision trees: A recent overview10.1007/s10462-011-9272-4 ↗
33. Random forests10.1023/A:1010933404324 ↗
34. Stochastic gradient boosting10.1016/S0167-9473(01)00065-2 ↗
35. What is a support vector machine?10.1038/nbt1206-1565 ↗
36. Linking Data to Ontologies
37. Staab, S., and Studer, R. (2009). An Overview of OntoClean. Handbook on Ontologies, Springer.10.1007/978-3-540-92673-3 ↗
38. An ontology engineering methodology for DOGMA10.3233/AO-2008-0047 ↗
39. DOLCE: A descriptive ontology for linguistic and cognitive engineering10.3233/AO-210259 ↗
40. Context-based information fusion: A survey and discussion10.1016/j.inffus.2015.01.002 ↗
41. Ferber, J., and Weiss, G. (1999). Multi-Agent Systems: An Introduction to Distributed Artificial Intelligence, Addison-Wesley Longman Publishing Co.
42. Bordini, R.H., and Hübner, J.F. (2005). BDI agent programming in AgentSpeak using Jason. Computational Logic in Multi-Agent Systems, Springer.10.1007/11750734_9 ↗
43. Joseph, L., and Cacace, J. (2018). Mastering ROS for Robotics Programming: Design, Build, and Simulate Complex Robots Using the Robot Operating System, Packt Publishing Ltd.
44. Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Ng, A.Y. (2009, January 12–17). ROS: An open-source Robot Operating System. Proceedings of the ICRA Workshop on Open Source Software, Kobe, Japan.10.1109/MRA.2010.936956 ↗
45. Koenig, N., and Howard, A. (October, January 28). Design and use paradigms for Gazebo, an open-source multi-robot simulator. Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)(IEEE Cat. No. 04CH37566), Sendai, Japan.
46. Marian, M., Stîngă, F., Georgescu, M.T., Roibu, H., Popescu, D., and Manta, F. (2020, January 27–29). A ROS-based control application for a robotic platform using the Gazebo 3D simulator. Proceedings of the 2020 21th International Carpathian Control Conference (ICCC), High Tatras, Slovakia.10.1109/ICCC49264.2020.9257256 ↗
47. Seidita, V., and Chella, A. (2024). Agents as a Design Paradigm for Robotic Systems Leveraging ROS and Gazebo. Agents and Robots for reliable Engineered Autonomy, Springer.10.1007/978-3-031-73180-8_2 ↗
48. Seidita, V., and Chella, A. (2024, January 8–10). Enhancing Robotic Systems in Healthcare: A Preliminary Analysis of Agent-Based Paradigms and Simulation Environments. Proceedings of the CEUR Workshop Proceedings, CEUR-WS, Bard, Italy.
49. Gouaillier, D., Hugel, V., Blazevic, P., Kilner, C., Monceaux, J., Lafourcade, P., Marnier, B., Serre, J., and Maisonnier, B. (2009, January 12–17). Mechatronic design of NAO humanoid. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.10.1109/ROBOT.2009.5152516 ↗
50. Borgo, S., Di Felice, M., Esposito, A., Seidita, V., Spaletta, G., Toni, R., and Zyrianoff, I. (May, January 29). POSTER: IoT and Humanoid Robotics for Next Generation Motor Rehabilitation Systems. Proceedings of the 2024 20th International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT), Abu Dhabi, United Arab Emirates.10.1109/DCOSS-IoT61029.2024.00120 ↗
51. Montecchiari, L., Trotta, A., Zyrianoff, I.D., Bononi, L., Natalizio, E., and Di Felice, M. (2023, January 12–27). A BLE Mesh Edge Framework for QoS-Aware IoT Monitoring Systems. Proceedings of the 2023 IEEE 9th World Forum on Internet of Things (WF-IoT), Aveiro, Portugal.10.1109/WF-IoT58464.2023.10539544 ↗
52. Borgo, S., Di Felice, M., Fasano, G., Masolo, C., Seidita, V., Spaletta, G., Barbaro, F., Di Conza, G., Quarantini, E., and Quarantini, M. (2024, January 15–19). Integrating Ontological Modelling, IoT and Humanoid Robotics for Motor Rehabilitation Systems. Proceedings of the Formal Ontology in Information Systems Conference 2024 (FOIS 2024), Enschede, The Netherlands.10.1109/DCOSS-IoT61029.2024.00120 ↗