journal article·2022-11-30Open access

Gamification of Upper Limb Rehabilitation in Mixed-Reality Environment

Aditya Pillai, Md Samiul Haque Sunny, Md Tanzil Shahria, Nayan Banik, Mohammad Habibur Rahman

Applied Sciences· Volume 12· Issue 23

Abstract

The advancements in mixed reality (MR) technology in recent years have provided us with excellent prospects for creating novel approaches to supplement conventional physiotherapy to maintain a sufficient quantity and quality of rehabilitation. The use of MR systems to facilitate patients’ participation in intensive, repetitive, and task-oriented practice using cutting-edge technologies to enhance functionality and facilitate recovery is very encouraging. Multiple studies have found that patients who undergo therapy using MR experience significant improvements in upper limb function; however, assessing the efficacy of MR is challenging due to the wide variety of methods and tools used. Because of these challenges, a novel approach, gamified MR-based solution for upper extremity rehabilitation, is proposed, which is an MR application for the Microsoft HoloLens 2, complete with game levels, and can measure the ranges of motion of the arm joints. The proposed rehabilitative system’s functionality and usability were evaluated with ten healthy adult participants with no prior arm-related injuries and two occupational therapists (OTs). The system successfully provided rehab exercises for upper limb injuries through interactive mixed-reality games. The system can mimic upper limb behavior without additional sensors during rehab sessions. Unlike previously researched technologically-based rehabilitation methods, this method can integrate arm–joint data within the application and are independent of one another. The results and comparisons show that this system is relevant, accurate, and superior to previous VR-based rehabilitation methods because the VR-based system is blind to the surroundings, whereas the proposed approach has spatial awareness of the environment.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Stroke Rehabilitation and Recovery · Musculoskeletal pain and rehabilitation · Cerebral Palsy and Movement Disorders

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Biorobotics Lab, University of Wisconsin-Milwaukee, Milwaukee, WI 53212, USA

Computer Science, University of Wisconsin-Milwaukee, Milwaukee, WI 53211, USA

Mechanical Engineering, University of Wisconsin-Milwaukee, Milwaukee, WI 53211, USA

References (44)

Show source-provided references
1. Epidemiology of the hand injuries in Bolu region: A retrospective clinical study10.5505/abantmedj.2012.76486 ↗
2. (2022, October 23). Upper Extremity Injury. Available online: https://www.jonathanohebmd.com/services/upper-extremity-injury.
3. Suppl-6, M13: Rehabilitation for shoulder instability–current approaches10.2174/1874325001711010957 ↗
4. Boredom in patients with acquired brain injuries during inpatient rehabilitation: A scoping review10.1080/09638288.2017.1354232 ↗
5. Wearable technology in stroke rehabilitation: Towards improved diagnosis and treatment of upper-limb motor impairment
6. The impact of gamification on students’ learning, engagement and behavior based on their personality traits10.1186/s40561-019-0098-x ↗
7. Augmented reality–based rehabilitation of gait impairments: Case report10.2196/17804 ↗
8. Effectiveness of Using Virtual Reality–Supported Exercise Therapy for Upper Extremity Motor Rehabilitation in Patients with Stroke: Systematic Review and Meta-analysis of Randomized Controlled Trials10.2196/24111 ↗
9. Aguilera-Rubio, Á., Cuesta-Gómez, A., Mallo-López, A., Jardón-Huete, A., Oña-Simbaña, E.D., and Alguacil-Diego, I.M. (2022). Feasibility and Efficacy of a Virtual Reality Game-Based Upper Extremity Motor Function Rehabilitation Therapy in Patients with Chronic Stroke: A Pilot Study. Int. J. Environ. Res. Public Health, 19.10.3390/ijerph19063381 ↗
10. Can Digital Games Be a Way of Improving the Neuroplasticity in Stroke Damage? Can the Adult Brain Grow New Cells or Rewire Itself in Response to a New Experience?10.4236/ojmp.2017.62013 ↗
11. Examining the effectiveness of virtual, augmented, and mixed reality (VAMR) therapy for upper limb recovery and activities of daily living in stroke patients: A systematic review and meta-analysis10.1186/s12984-022-01071-x ↗
12. Phan, H.L., Le, T.H., Lim, J.M., Hwang, C.H., and Koo, K.i. (2022). Effectiveness of augmented reality in stroke rehabilitation: A Meta-Analysis. Appl. Sci., 12.10.3390/app12041848 ↗
13. Effect of traditional plus virtual reality rehabilitation on prognosis of stroke survivors: A systematic review and meta-analysis of randomized controlled trials10.1097/PHM.0000000000001775 ↗
14. Combined cognitive-motor rehabilitation in virtual reality improves motor outcomes in chronic stroke–a pilot study10.3389/fpsyg.2018.00854 ↗
15. Miclaus, R., Roman, N., Caloian, S., Mitoiu, B., Suciu, O., Onofrei, R.R., Pavel, E., and Neculau, A. (2020). Non-Immersive virtual reality for post-stroke upper extremity rehabilitation: A small cohort randomized trial. Brain Sci., 10.10.3390/brainsci10090655 ↗
16. An innovative STRoke Interactive Virtual thErapy (STRIVE) online platform for community-dwelling stroke survivors: A randomized controlled trial10.1016/j.apmr.2020.03.011 ↗
17. A low cost kinect-based virtual rehabilitation system for inpatient rehabilitation of the upper limb in patients with subacute stroke: A randomized, double-blind, sham-controlled pilot trial10.1097/MD.0000000000011173 ↗
18. Home-based upper extremity stroke therapy using a multiuser virtual reality environment: A randomized trial10.1016/j.apmr.2019.10.182 ↗
19. Efficacy of a video-based physical therapy and rehabilitation system in patients with post-stroke hemiplegia: A randomized, controlled, pilot study
20. Task-specific virtual reality training on hemiparetic upper extremity in patients with stroke10.1007/s10055-021-00583-6 ↗
21. Game-based virtual reality canoe paddling training to improve postural balance and upper extremity function: A preliminary randomized controlled study of 30 patients with subacute stroke
22. Influence of Nintendo Wii Fit balance game on visual perception, postural balance, and walking in stroke survivors: A pilot randomized clinical trial10.1089/g4h.2017.0126 ↗
23. Effects of a virtual reality video game exercise program on upper extremity function and daily living activities in stroke patients10.1589/jpts.30.1408 ↗
24. Effects of Virtual Reality Based Therapeutic Exercise on the Upper Extremity Function and Activities of Daily Living in Patients with Acute Stroke: A Pilot Randomized Controlled Trial10.37506/mlu.v21i2.2761 ↗
25. Efficacy of virtual reality combined with real instrument training for patients with stroke: A randomized controlled trial10.1016/j.apmr.2019.03.013 ↗
26. Ahmad, M.A., Singh, D.K.A., Mohd Nordin, N.A., Hooi Nee, K., and Ibrahim, N. (2019). Virtual reality games as an adjunct in improving upper limb function and general health among stroke survivors. Int. J. Environ. Res. Public Health, 16.10.3390/ijerph16245144 ↗
27. Virtual reality for upper limb rehabilitation in subacute and chronic stroke: A randomized controlled trial10.1016/j.apmr.2018.01.023 ↗
28. The effect of virtual reality-based therapy on improving upper limb functions in individuals with stroke: A randomized control trial10.3389/fnagi.2021.731343 ↗
29. Effects of virtual reality associated with serious games for upper limb rehabilitation in patients with multiple sclerosis: Randomized controlled trial
30. Virtual reality in upper extremity rehabilitation of stroke patients: A randomized controlled trial10.1016/j.jstrokecerebrovasdis.2018.08.007 ↗
31. Effects of Kinect-based virtual reality game training on upper extremity motor recovery in chronic stroke10.1080/08990220.2018.1444599 ↗
32. Ain, Q.U., Khan, S., Ilyas, S., Yaseen, A., Tariq, I., Liu, T., and Wang, J. (2021). Additional effects of Xbox kinect training on upper limb function in chronic stroke patients: A randomized control trial. Healthcare, 9.10.3390/healthcare9030242 ↗
33. Blasco-Peris, C., Fuertes-Kenneally, L., Vetrovsky, T., Sarabia, J.M., Climent-Paya, V., and Manresa-Rocamora, A. (2022). Effects of Exergaming in Patients with Cardiovascular Disease Compared to Conventional Cardiac Rehabilitation: A Systematic Review and Meta-Analysis. Int. J. Environ. Res. Public Health, 19.10.3390/ijerph19063492 ↗
34. Video game rehabilitation for outpatient stroke (VIGoROUS): A multi-site randomized controlled trial of in-home, self-managed, upper-extremity therapy10.1016/j.eclinm.2021.101239 ↗
35. Effects of Augmented Reality Interventions on the Function of Upper Extremity and Balance in Children with Spastic Hemiplegic Cerebral Palsy: A Randomized Clinical Trial10.3389/fneur.2022.895055 ↗
36. (2022, October 23). HoloLens 2—Overview, Features, and Specs|Microsoft HoloLens. Available online: https://www.microsoft.com/en-us/hololens/hardware].
37. (2022, October 23). Technologies. Unity. Available online: https://unity.com.
38. (2022, October 23). Visual Studio: IDE and Code Editor for Software Developers and Teams. Available online: https://visualstudio.microsoft.com.
39. (2022, October 23). Microsoft. MRTK2-Unity Developer Documentation—MRTK 2. Available online: https://learn.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/mrtk2/?view=mrtkunity-2022-05.
40. Technologies, U. (2022, October 22). Unity-Scripting API: Ray. Available online: https://docs.unity3d.com/ScriptReference/Ray.html.
41. Faity, G., Mottet, D., and Froger, J. (2022). Validity and reliability of Kinect v2 for quantifying upper body kinematics during seated reaching. Sensors, 22.10.1101/2022.01.18.476737 ↗
42. Kinect and wearable inertial sensors for motor rehabilitation programs at home: State of the art and an experimental comparison10.1186/s12938-020-00762-7 ↗
43. Ma, M., Proffitt, R., and Skubic, M. (2018). Validation of a Kinect V2 based rehabilitation game. PLoS ONE, 13.10.1371/journal.pone.0202338 ↗
44. NAO robot for cooperative rehabilitation training