An intelligent glove interface with integrated perceptual simulation and motion tracking for enhanced virtual interactions

Emerging technologies that bridge the real and virtual worlds are pivotal for enhancing virtual interactions. Current devices, such as smart gloves, often focus solely on hand motion tracking or provide limited haptic feedback, restricting user experiences. Here, a haptic intelligent motion tracking (HIMT) glove designed for enhanced virtual interactions is proposed. The glove includes optimized electromagnetic vibrators that allow users to perceive the shapes and weights of virtual objects accurately. Additionally, graphene fiber sensors were developed for upper-limb motion tracking incorporating inertial measurement units (IMUs). Evaluations in virtual interactive physiotherapy demonstrate that the glove enhances the willingness to engage in rehabilitation training. Furthermore, users achieve a high diagnostic accuracy of 96.1% when assessing virtual patients. The HIMT glove demonstrates significant potential as a comprehensive solution for human-virtual interactions, promising wide future applications in fields such as physiotherapy, medical training, education, sports, and entertainment.