Evaluation of Occupational Exoskeletons: A Comprehensive Protocol for Experimental Design and Analysis
Source abstract
Abstract
This paper proposes a modular protocol for the designing of experimental studies to analyze exoskeletons used in industrial settings to support manual material handling (MMH). Despite exoskeleton technologies starting to be highly commercialized and present in workplaces, research still lacks a standardized procedure for analyzing the impact of these devices on workers. The protocol presented in this paper outlines a step-by-step procedure, including the parameters to be collected and analyzed in a research study. Moreover, the approach could be easily adapted to meet the specificity of a wide range of exoskeletons. The main novelty of the protocol is thus to support the experimental design and analysis of studies assessing the overall impact of exoskeletons on workers. To implement the protocol, the selected case study concerned a palletizing task involving the MMH of 12 cardboard boxes, weighing 10 kg. The results from physiological signals and pressure insoles show that the protocol is comprehensive and can be utilized by researchers evaluating different occupational exoskeletons for assistance during MMH (both active and passive), with modifications to specific parts based on the type of exoskeleton being assessed or the variables of interest.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Prosthetics and Rehabilitation Robotics · Ergonomics and Human Factors
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Engineering “Enzo Ferrari” (DIEF), University of Modena and Reggio Emilia, via P. Vivarelli, 10, 41125 Modena, Italy
Interdepartmental Research Center on Security and Safety (CRIS), University of Modena and Reggio Emilia, via P. Vivarelli, 10, 41125 Modena, Italy
European Interdisciplinary Applied Research Center for Safety (EURSAFE), Strada della Repubblica 41, 43121 Parma, Italy
Department of Communication and Economics, University of Modena and Reggio Emilia, viale Antonio Allegri, 9, 42121 Reggio Emilia, Italy
Intermech MO.RE., University of Modena and Reggio Emilia, 41125 Modena, Italy
Department of Industrial Engineering (DIN), University of Bologna, viale Risorgimento 2, 40132 Bologna, Italy
Funding
Department of Industrial Engineering “Enzo Ferrari” (DIEF) of the University of Modena and Reggio Emilia · University of Modena and Reggio Emilia · Fondazione di Modena
References (48)
Show source-provided references
1. Evaluation of Trunk-Supporting Exoskeleton10.1177/1071181319631261 ↗
2. Methodologies for evaluating exoskeletons with industrial applications10.1080/00140139.2021.1970823 ↗
3. Qu, X., Qu, C., Ma, T., Yin, P., Zhao, N., Xia, Y., and Qu, S. (2021). Effects of an industrial passive assistive exoskeleton on muscle activity, oxygen consumption and subjective responses during lifting tasks. PLoS ONE, 16.10.1371/journal.pone.0245629 ↗
4. An industrial exoskeleton user acceptance framework based on a literature review of empirical studies10.1016/j.apergo.2021.103615 ↗
5. Botti, L., and Melloni, R. (2023). Occupational Exoskeletons: Understanding the Impact on Workers and Suggesting Guidelines for Practitioners and Future Research Needs. Appl. Sci., 14.10.3390/app14010084 ↗
6. Assessment of an active industrial exoskeleton to aid dynamic lifting and lowering manual handling tasks10.1016/j.apergo.2017.11.004 ↗
7. Lazzaroni, M., Fanti, V., Sposito, M., Chini, G., Draicchio, F., Di Natali, C., Caldwell, D.G., and Ortiz, J. (2022, January 21–24). Improving the Efficacy of an Active Back-Support Exoskeleton for Manual Material Handling Using the Accelerometer Signal. Proceedings of the IEEE RAS and EMBS International Conference on Biomedical Robotics and Biomechatronics, Seoul, Republic of Korea.10.1109/BioRob52689.2022.9925414 ↗
8. IMU-based human activity recognition and payload classification for low-back exoskeletons10.1038/s41598-023-28195-x ↗
9. Schwartz, M., Desbrosses, K., Theurel, J., and Mornieux, G. (2023). Biomechanical Consequences of Using Passive and Active Back-Support Exoskeletons during Different Manual Handling Tasks. Int. J. Environ. Res. Public Health, 20.10.3390/ijerph20156468 ↗
10. Di Natali, C., Chini, G., Toxiri, S., Monica, L., Anastasi, S., Draicchio, F., Caldwell, D.G., and Ortiz, J. (2021). Equivalent Weight: Connecting Exoskeleton Effectiveness with Ergonomic Risk during Manual Material Handling. Int. J. Environ. Res. Public Health, 18.10.3390/ijerph18052677 ↗
11. (2019). Exploring Neuroergonomic Fit of Passive Exoskeletons during Manual Handling Tasks. Proc. Hum. Factors Ergon. Soc. Annu. Meet., 63, 1112.10.1177/1071181319631302 ↗
12. Benchmarking occupational exoskeletons: An evidence mapping systematic review10.1016/j.apergo.2021.103582 ↗
13. Wang, H.-M., Le, D.K.L., and Lin, W.-C. (2021). Evaluation of a Passive Upper-Limb Exoskeleton Applied to Assist Farming Activities in Fruit Orchards. Appl. Sci., 11.10.3390/app11020757 ↗
14. Effectiveness of an on-body lifting aid (HAL® for care support) to reduce lower back muscle activity during repetitive lifting tasks10.1016/j.jocn.2019.01.038 ↗
15. Shoulder muscle activity and perceived comfort of industry workers using a commercial upper limb exoskeleton for simulated tasks10.1016/j.apergo.2022.103718 ↗
16. Exoskeletons for industrial application and their potential effects on physical work load10.1080/00140139.2015.1081988 ↗
17. (2024). Sicurezza e Salute Nell’uso Degli Esoscheletri Occupazionali Orientati ad Agevolare le Attività Lavorative (Standard No. UNI/TR 11950:2024).
18. Performance Evaluation of Lower Limb Exoskeletons: A Systematic Review10.1109/TNSRE.2020.2989481 ↗
19. Massardi, S., Rodriguez-Cianca, D., Pinto-Fernandez, D., Moreno, J.C., Lancini, M., and Torricelli, D. (2022). Characterization and Evaluation of Human–Exoskeleton Interaction Dynamics: A Review. Sensors, 22.10.3390/s22113993 ↗
20. Biomechanical Evaluation of Passive Back-Support Exoskeletons in a Precision Manual Assembly Task: “Expected” Effects on Trunk Muscle Activity, Perceived Exertion, and Task Performance10.1177/0018720819890966 ↗
21. Short-Term Effects of a Passive Spinal Exoskeleton on Functional Performance, Discomfort and User Satisfaction in Patients with Low Back Pain10.1007/s10926-020-09899-7 ↗
22. Baldassarre, A., Lulli, L.G., Cavallo, F., Fiorini, L., Mariniello, A., Mucci, N., and Arcangeli, G. (2022). Industrial exoskeletons from bench to field: Human-machine interface and user experience in occupational settings and tasks. Front. Public Health, 10.10.3389/fpubh.2022.1039680 ↗
23. Botti, L., Bacchetta, A.P., Oliva, M., and Melloni, R. (2023, January 20–24). Exoskeletons at work: Opportunities, suggestions for implementation and future research needs. Proceedings of the AHFE 2023 International Conference, San Francisco, CA, USA. Human Aspects of Advanced Manufacturing.10.54941/ahfe1003510 ↗
24. Hartmann, V.N., Rinaldi, D.d.M., Taira, C., and Forner-Cordero, A. (2021). Industrial Upper-Limb Exoskeleton Characterization: Paving the Way to New Standards for Benchmarking. Machines, 9.10.3390/machines9120362 ↗
25. Schmalz, T., Schändlinger, J., Schuler, M., Bornmann, J., Schirrmeister, B., Kannenberg, A., and Ernst, M. (2019). Biomechanical and Metabolic Effectiveness of an Industrial Exoskeleton for Overhead Work. Int. J. Environ. Res. Public Health, 16.10.3390/ijerph16234792 ↗
26. Passive Shoulder Exoskeletons: More Effective in the Lab Than in the Field?10.1109/TNSRE.2020.3041906 ↗
27. Botti, L., Melloni, R., Oliva, M., Perini, M., and Bacchetta, A.P. (2023). Exoskeletons to Support Manual Material Handling at Work: A Preliminary Study. Production Processes and Product Evolution in the Age of Disruption, Springer. Lecture Notes in Mechanical Engineering.10.1007/978-3-031-34821-1_91 ↗
28. Cohen, J. (1998). Statistical Power Analysis for the Behavioral Sciences, Routledge. [2nd ed.].
29. Understanding statistical power in the context of applied research10.1016/j.apergo.2004.01.002 ↗
30. (2024, July 21). G*Power. Available online: https://www.psychologie.hhu.de/arbeitsgruppen/allgemeine-psychologie-und-arbeitspsychologie/gpower.
31. Some Practical Guidelines for Effective Sample Size Determination10.1198/000313001317098149 ↗
32. Holzinger, A. (2008). Construction and Evaluation of a User Experience Questionnaire. HCI and Usability for Education and Work, Springer.10.1007/978-3-540-89350-9 ↗
33. On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other10.1214/aoms/1177730491 ↗
34. The Proof and Measurement of Association between Two Things10.2307/1412159 ↗
35. Laevo, B.V. (2024, June 19). LAEVO V2. Available online: https://www.laevo-exoskeletons.com/en/laevo-v2.
36. Mrugalska, B., Karwowski, W., and Trzcielinski, S. (2024). Exoskeletons in action: The impact of exoskeletons on human factors during manual material handling. Human Aspects of Advanced Manufacturing, Production Management and Process Control, AHFE International.
37. (2017). Basic Human Body Measurements for Technological Design. Part 1: Body Measurement Definitions and Landmarks (Standard No. ISO 7250-1:2017).
38. (2024, July 21). FlexInFit. Available online: https://www.sensormedica.com/it/flexinfit/.
39. Sensor Medica (2024, July 21). freeStep. Available online: https://www.sensormedica.com/it/freestep/.
40. Empatica (2024, July 21). Empatica E4. Available online: https://www.empatica.com/en-eu/research/e4/.
41. (2024, July 21). Turingsense EU Lab. Available online: https://www.turingsense.eu/.
42. SUITX (2024, July 21). IX Back Air. Available online: https://www.suitx.com/en/products/ix-back-air-exoskeleton.
43. vd Grinten, M.P., and Smitt, P. (1992). Development of a practical method for measuring body part discomfort. Advances in Industrial Egonomics and Safety IV, CRC Press.
44. Albert, W., and Tullis, T.S. (2023). Self-Reported Metrics. Measuring the User Experience, Elsevier.10.1016/B978-0-12-818080-8.00005-4 ↗
45. (2009). World Medical Association (WMA). Declaration of Helsinki. Ethical principles for medical research involving human subjects. Jahrb. Für Wiss. Und Ethik, 14, 233–238.10.1515/9783110208856.233 ↗
46. (2024, July 21). Convention for the Protection of Human Rights and Dignity of the Human Being with regard to the Application of Biology and Medicine: Convention on Human Rights and Biomedicine, Available online: https://pubmed.ncbi.nlm.nih.gov/9363733/.
47. Objective and Subjective Effects of a Passive Exoskeleton on Overhead Work10.1109/TNSRE.2019.2945368 ↗
48. Fund behavioral science like the frameworks we endorse: The case for increased funding of preliminary studies by the National Institutes of Health10.1186/s40814-022-01179-w ↗