A Wearable Sonification System to Improve Movement Awareness: A Feasibility Study
Source abstract
Abstract
This paper presents the design, development, and feasibility testing of a wearable sonification system for real-time posture monitoring and feedback. The system utilizes inexpensive motion sensors integrated into a compact, wearable package to measure body movements and standing balance continuously. The sensor data is processed through sonification algorithms to generate real-time auditory feedback cues indicating the user’s balance and posture. The system aims to improve movement awareness and physical conditioning, with potential applications in balance rehabilitation and physical therapy. Initial feasibility testing was conducted with a small group of healthy participants performing standing balance tasks with eyes open and closed. Results indicate that the real-time audio feedback improved participants’ ability to maintain balance, especially in the case of closed eyes. This preliminary study demonstrates the potential for wearable sonification systems to provide intuitive real-time feedback on posture and movement to improve motor skills and balance.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Tactile and Sensory Interactions · Balance, Gait, and Falls Prevention · Muscle activation and electromyography studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Industrial Design, School of Design, College of Design and Social Context, RMIT University, Melbourne, VIC 3000, Australia
Electrical and Biomedical Engineering, School of Engineering, STEM College, RMIT University, Melbourne, VIC 3000, Australia
Manufacturing, Materials and Mechatronics Engineering, School of Engineering, STEM College, RMIT University, Melbourne, VIC 3000, Australia
Funding
Strategic Impact Fund 2023
References (51)
Show source-provided references
1. Waer, F.B., Sahli, S., Alexe, C.I., Man, M.C., Alexe, D.I., and Burchel, L.O. (2024). The Effects of Listening to Music on Postural Balance in Middle-Aged Women. Sensors, 24.10.21203/rs.3.rs-2835043/v1 ↗
2. Smartphone-based gait and balance accelerometry is sensitive to age and correlates with clinical and kinematic data10.1016/j.gaitpost.2022.11.014 ↗
3. Longitudinal Associations Between Falls and Risk of Gait Decline: Results From the Central Control of Mobility and Aging Study10.1016/j.apmr.2022.08.975 ↗
4. Höök, K., Caramiaux, B., Erkut, C., Forlizzi, J., Hajinejad, N., Haller, M., Hummels, C.C.M., Isbister, K., Jonsson, M., and Khut, G. (2018). Embracing first-person perspectives in soma-based design. Informatics, 5.10.3390/informatics5010008 ↗
5. Gao, S., Chen, J., Dai, Y., and Hu, B. (2022). Wearable Systems Based Gait Monitoring and Analysis, Springer International Publishing. [1st ed.].10.1007/978-3-030-97332-2 ↗
6. Using Human–Machine Interfaces to Convey Feedback in Automated Driving10.1177/15553434221076827 ↗
7. (2018). Wearable Technologies: Concepts, Methodologies, Tools, and Applications, IGI Global.
8. Deng, Z., Guo, L., Chen, X., and Wu, W. (2023). Smart Wearable Systems for Health Monitoring. Sensors, 23.10.3390/s23052479 ↗
9. Alim, A., and Imtiaz, M.H. (2023). Wearable Sensors for the Monitoring of Maternal Health-A Systematic Review. Sensors, 23.10.3390/s23052411 ↗
10. Stavropoulos, T.G., Papastergiou, A., Mpaltadoros, L., Nikolopoulos, S., and Kompatsiaris, I. (2020). IoT Wearable Sensors and Devices in Elderly Care: A Literature Review. Sensors, 20.10.3390/s20102826 ↗
11. de-la-Fuente-Robles, Y.-M., Ricoy-Cano, A.-J., Albín-Rodríguez, A.-P., López-Ruiz, J.L., and Espinilla-Estévez, M. (2022). Past, Present and Future of Research on Wearable Technologies for Healthcare: A Bibliometric Analysis Using Scopus. Sensors, 22.10.3390/s22228599 ↗
12. Alt Murphy, M., Bergquist, F., Hagström, B., Hernández, N., Johansson, D., Ohlsson, F., Sandsjö, L., Wipenmyr, J., and Malmgren, K. (2019). An upper body garment with integrated sensors for people with neurological disorders—Early development and evaluation. BMC Biomed. Eng., 1.10.1186/s42490-019-0002-3 ↗
13. A review of e-textiles in neurological rehabilitation: How close are we?10.1186/s12984-016-0167-0 ↗
14. Embodied Engagement: Supporting Movement Awareness in Ubiquitous Computing Systems10.18848/1835-9795/CGP/v03i04/40309 ↗
15. Hybrid Human-Machine Interface for Gait Decoding Through Bayesian Fusion of EEG and EMG Classifiers10.3389/fnbot.2020.582728 ↗
16. Auditory feedback in tele-rehabilitation based on automated gait classification10.1007/s00779-023-01723-2 ↗
17. Wall, C., McMeekin, P., Walker, R., Hetherington, V., Graham, L., and Godfrey, A. (2024). Sonification for Personalised Gait Intervention. Sensors, 24.10.3390/s24010065 ↗
18. Real-Time Identification of Gait Events in Impaired Subjects Using a Single-IMU Foot-Mounted Device10.1109/JSEN.2019.2951923 ↗
19. Kok, M., Hol, J.D., and Schön, T.B. (2017). Using Inertial Sensors for Position and Orientation Estimation. arXiv.10.1561/9781680833577 ↗
20. Moon, K.S., Lee, S.Q., Ozturk, Y., Gaidhani, A., and Cox, J.A. (2019). Identification of Gait Motion Patterns Using Wearable Inertial Sensor Network. Sensors, 19.10.3390/s19225024 ↗
21. Instrumenting gait with an accelerometer: A system and algorithm examination10.1016/j.medengphy.2015.02.003 ↗
22. Zhou, H., Ji, N., Samuel, O.W., Cao, Y., Zhao, Z., Chen, S., and Li, G. (2016). Towards Real-Time Detection of Gait Events on Different Terrains Using Time-Frequency Analysis and Peak Heuristics Algorithm. Sensors, 16.10.3390/s16101634 ↗
23. Gait Event Detection in Real-World Environment for Long-Term Applications: Incorporating Domain Knowledge Into Time-Frequency Analysis10.1109/TNSRE.2016.2536278 ↗
24. Ji, N., Zhou, H., Guo, K., Samuel, O.W., Huang, Z., Xu, L., and Li, G. (2019). Appropriate mother wavelets for continuous gait event detection based on time-frequency analysis for hemiplegic and healthy individuals. Sensors, 19.10.3390/s19163462 ↗
25. Instrumented gait assessment with a single wearable: An introductory tutorial10.12688/f1000research.9591.1 ↗
26. Gait recording with inertial sensors—How to determine initial and terminal contact10.1016/j.jbiomech.2015.12.035 ↗
27. A Low Cost Alternative to Monitor Human Gait Temporal Parameters-Wearable Wireless Gyroscope10.1109/JSEN.2016.2616163 ↗
28. A robust real-time gait event detection using wireless gyroscope and its application on normal and altered gaits10.1016/j.medengphy.2014.12.004 ↗
29. Towards a unified terminology for sonification and visualisation10.1007/s00779-023-01720-5 ↗
30. Effects of auditory feedback on gait behavior, gaze patterns and outcome performance in long jumping10.1016/j.humov.2021.102827 ↗
31. Reh, J., Schmitz, G., Hwang, T.-H., and Effenberg, A.O. (2022). Loudness affects motion: Asymmetric volume of auditory feedback results in asymmetric gait in healthy young adults. BMC Musculoskelet. Disord., 23.10.1186/s12891-022-05503-6 ↗
32. Raglio, A., De Maria, B., Parati, M., Giglietti, A., Premoli, S., Salvaderi, S., Molteni, D., Ferrante, S., and Dalla Vecchia, L.A. (2023). Movement Sonification Techniques to Improve Balance in Parkinson’s Disease: A Pilot Randomized Controlled Trial. Brain Sci., 13.10.3390/brainsci13111586 ↗
33. A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation10.3389/fpsyg.2019.00244 ↗
34. The Psychophysiological Effects of Different Tempo Music on Endurance Versus High-Intensity Performances10.3389/fpsyg.2020.00074 ↗
35. Dubus, G., and Bresin, R. (2013). A Systematic Review of Mapping Strategies for the Sonification of Physical Quantities. PLoS ONE, 8.10.1371/journal.pone.0082491 ↗
36. Movement Sonification: Effects on Perception and Action10.1109/MMUL.2005.31 ↗
37. Neurobiological foundations of neurologic music therapy: Rhythmic entrainment and the motor system10.3389/fpsyg.2014.01185 ↗
38. Effects of Real-Time (Sonification) and Rhythmic Auditory Stimuli on Recovering Arm Function Post Stroke: A Systematic Review and Meta-Analysis10.3389/fneur.2018.00488 ↗
39. Movement Sonification: Effects on Motor Learning beyond Rhythmic Adjustments10.3389/fnins.2016.00219 ↗
40. Auditory white noise reduces postural fluctuations even in the absence of vision10.1007/s00221-015-4304-y ↗
41. Mapping Sonification for Perception and Action in Motor Skill Learning10.3389/fnins.2017.00463 ↗
42. Auditory biofeedback substitutes for loss of sensory information in maintaining stance10.1007/s00221-006-0709-y ↗
43. On the Relevance of Auditory Feedback for Quality of Control in a Balancing Task10.3813/AAA.918003 ↗
44. Audio-biofeedback for balance improvement: An accelerometry-based system10.1109/TBME.2005.857673 ↗
45. Effect of continuous auditory feedback (CAF) on human movements and motion awareness10.1016/j.medengphy.2022.103902 ↗
46. Timing movements to interval durations specified by discrete or continuous sounds10.1007/s00221-011-2837-2 ↗
47. Beyond the metronome: Auditory events and music may afford more than just interval durations as gait cues in Parkinson’s disease10.3389/fnins.2016.00272 ↗
48. Rhythmic auditory stimulation in gait training for Parkinson’s disease patients10.1002/mds.870110213 ↗
49. Investigating three types of continuous auditory feedback in visuo-manual tracking10.1007/s00221-016-4827-x ↗
50. Françoise, J., Chapuis, O., Hanneton, S., and Bevilacqua, F. (2016, January 7–12). SoundGuides: Adapting Continuous Auditory Feedback to Users. Proceedings of the Conference Extended Abstracts on Human Factors in Computing Systems (CHI 2016), San Jose, CA, USA.10.1145/2851581.2892420 ↗
51. Effect of task-related continuous auditory feedback during learning of tracking motion exercises10.1186/1743-0003-9-79 ↗