journal article·2020-10-08Open access

Development and Application of a Human–Machine Interface Using Head Control and Flexible Numeric Tables for the Severely Disabled

Che-Ming Chang, Chern-Sheng Lin, Wei-Cheng Chen, Chung-Ting Chen, Yu-Liang Hsu

Applied Sciences· Volume 10· Issue 19

Abstract

The human–machine interface with head control can be applied in many domains. This technology has the valuable application of helping people who cannot use their hands, enabling them to use a computer or speak. This study combines several image processing and computer vision technologies, a digital camera, and software to develop the following system: image processing technologies are adopted to capture the features of head motion; the recognized head gestures include forward, upward, downward, leftward, rightward, right-upper, right-lower, left-upper, and left-lower; corresponding sound modules are used so that patients can communicate with others through a phonetic system and numeric tables. Innovative skin color recognition technology can obtain head features in images. The barycenter of pixels in the feature area is then quickly calculated, and the offset of the barycenter is observed to judge the direction of head motion. This architecture can substantially reduce the distraction of non-targeted objects and enhance the accuracy of systematic judgment.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Hand Gesture Recognition Systems · Gaze Tracking and Assistive Technology · Tactile and Sensory Interactions

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Ph.D. Program of Electrical and Communications Engineering, Feng Chia University, Taichung 407, Taiwan

Department of Automatic Control Engineering, Feng Chia University, Taichung 40724, Taiwan

Master’s Program of Biomedical Informatics and Biomedical Engineering, Feng Chia University, Taichung 40724, Taiwan

Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei 106335, Taiwan

Funding

Ministry of Science and Technology, Taiwan

References (22)

Show source-provided references
1. Effect of age on human–computer interface control via neck electromyography10.1093/iwc/iwu030 ↗
2. Handy: A real-time three color glove-based gesture recognizer with learning vector quantization10.1016/j.eswa.2012.02.081 ↗
3. Design of virtual keyboard using blink control method for the severely disabled10.1016/j.cmpb.2013.04.012 ↗
4. The design idea and use intention evaluation of a public installation of an eye-gaze system10.1080/10400435.2011.567370 ↗
5. Boosted key-frame selection and correlated pyramidal motion-feature representation for human action recognition10.1016/j.patcog.2012.10.004 ↗
6. A survey of applications and human motion recognition with microsof kinect10.1142/S0218001415550083 ↗
7. Microswitch clusters to enhance adaptive responses and head control: A programme extension for three children with multiple disabilities10.1080/09638280500030472 ↗
8. Spatiotemporal analysis of human activities for biometric authentication10.1016/j.cviu.2011.08.009 ↗
9. A novel device for head gesture measurement system in combination with eye-controlled human–machine interface10.1016/j.optlaseng.2005.06.005 ↗
10. A real-time human-robot interaction system based on gestures for assistive scenarios10.1016/j.cviu.2016.03.004 ↗
11. An integrated approach for head gesture based interface10.1016/j.asoc.2011.11.014 ↗
12. Head-gestures mirroring detection in dyadic social interactions with computer vision-based wearable devices10.1016/j.neucom.2015.05.131 ↗
13. Gesture phase segmentation using support vector machines10.1016/j.eswa.2016.02.021 ↗
14. Intelligent wheelchair system based on sEMG and head gesture10.1016/S1005-8885(15)60642-2 ↗
15. Recent method sand databases in vision-based hand gesture recognition: A review10.1016/j.cviu.2015.08.004 ↗
16. Gesture control using single camera for PC10.1016/j.procs.2016.02.024 ↗
17. A kinect-based sign language hand gesture recognition system for hearing- and speech-impaired: A pilot study of pakistani sign language10.1080/10400435.2014.952845 ↗
18. Trajectory tracking control of an underactuated underwater vehicle redundant manipulator system10.1002/asjc.1291 ↗
19. An insight into the algorithms on real-time people tracking and counting system
20. Kinect-based taiwanese sign-language recognition system10.1007/s11042-014-2290-x ↗
21. The designs and applications of a scanning interface with electrical signal detection on the scalp for the severely disabled10.1016/j.cmpb.2015.07.007 ↗
22. Motion capture camera system for measurement of head and shoulders position