journal article·2023-02-28Open access

Soft Wireless Headband Bioelectronics and Electrooculography for Persistent Human–Machine Interfaces

Seunghyeb Ban, Yoon Jae Lee, Shinjae Kwon, Yun-Soung Kim, Jae Won Chang, Jong-Hoon Kim, Woon-Hong Yeo

Abstract

Recent advances in wearable technologies have enabled ways for people to interact with external devices, known as human-machine interfaces (HMIs). Among them, electrooculography (EOG), measured by wearable devices, is used for eye movement-enabled HMI. Most prior studies have utilized conventional gel electrodes for EOG recording. However, the gel is problematic due to skin irritation, while separate bulky electronics cause motion artifacts. Here, we introduce a low-profile, headband-type, soft wearable electronic system with embedded stretchable electrodes, and a flexible wireless circuit to detect EOG signals for persistent HMIs. The headband with dry electrodes is printed with flexible thermoplastic polyurethane. Nanomembrane electrodes are prepared by thin-film deposition and laser cutting techniques. A set of signal processing data from dry electrodes demonstrate successful real-time classification of eye motions, including blink, up, down, left, and right. Our study shows that the convolutional neural network performs exceptionally well compared to other machine learning methods, showing 98.3% accuracy with six classes: the highest performance till date in EOG classification with only four electrodes. Collectively, the real-time demonstration of continuous wireless control of a two-wheeled radio-controlled car captures the potential of the bioelectronic system and the algorithm for targeting various HMI and virtual reality applications.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Gaze Tracking and Assistive Technology · Advanced Sensor and Energy Harvesting Materials · EEG and Brain-Computer Interfaces

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Engineering and Computer Science, Washington State University, Vancouver, Washington 98686, United States

IEN Center for Human-Centric Interfaces and Engineering at the Institute for Electronics and Nanotechnology, Georgia Institute of Technology, Atlanta, Georgia 30332, United States

School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332, United States

George W. Woodruff School of Mechanical Engineering, College of Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332, United States

BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York 10029, United States

Department of Otolaryngology Head and Neck Surgery, School of Medicine, Chungnam National University Hospital, Daejeon 35015, Republic of Korea

Department of Mechanical Engineering, University of Washington, Seattle, Washington 98195, United States

Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University School of Medicine, Atlanta, Georgia 30332, United States

Parker H. Petit Institute for Bioengineering and Biosciences, Institute for Materials, Neural Engineering Center, Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta, Georgia 30332, United States

Funding

Georgia Institute of Technology · Korea Medical Device Development Fund · Division of Chemical, Bioengineering, Environmental, and Transport Systems

References (49)

Show source-provided references
1. Kartsch, V.; Guermandi, M.; Benatti, S.; Montagna, F.; Benini, L. An Energy-Efficient IoT node for HMI applications based on an ultra-low power Multicore Processor.IEEE Sensors Applications Symposium (SAS), 2019; IEEE, 2019; pp 1–6.10.1109/SAS.2019.8705984 ↗
2. 10.1080/03091902.2020.185383810.1080/03091902.2020.1853838 ↗
3. 10.3233/ais-2009-002010.3233/ais-2009-0020 ↗
4. 10.1155/2014/71381810.1155/2014/713818 ↗
5. 10.1109/TPAMI.2010.8610.1109/TPAMI.2010.86 ↗
6. Poon, C. C.; Leung, E. Y.; Lau, K. C.; Leung, B. H.; Zheng, Y. L.; Chiu, P. W.; Yam, Y. A novel user-specific wearable controller for surgical robots.International Conference of Design, User Experience, and Usability; Springer, 2015; pp 693–701.10.1007/978-3-319-20889-3_64 ↗
7. 10.3138/ptc.2011-0310.3138/ptc.2011-03 ↗
8. 10.1097/phm.0b013e31826bcedb10.1097/phm.0b013e31826bcedb ↗
9. 10.1155/2013/24325710.1155/2013/243257 ↗
11. Siddiqui U. · Int. J. Adv. Res. Comput. Commun. Eng. · 2013 · 2 · 4328
12. 10.1038/s41699-018-0064-410.1038/s41699-018-0064-4 ↗
13. 10.3390/ma1316358710.3390/ma13163587 ↗
14. 10.1016/j.bios.2017.01.04410.1016/j.bios.2017.01.044 ↗
15. 10.1088/1741-2560/11/5/05601810.1088/1741-2560/11/5/056018 ↗
16. 10.1109/TNSRE.2002.80682910.1109/TNSRE.2002.806829 ↗
17. 10.1016/j.bspc.2014.10.00510.1016/j.bspc.2014.10.005 ↗
18. 10.1109/TBME.2013.224815410.1109/TBME.2013.2248154 ↗
19. 10.3390/bios1211103910.3390/bios12111039 ↗
20. Dhuliawala, M.; Lee, J.; Shimizu, J.; Bulling, A.; Kunze, K.; Starner, T.; Woo, W. Smooth eye movement interaction using EOG glasses.Proceedings of the 18th ACM International Conference on Multimodal Interaction, 2016; pp 307–311.10.1145/2993148.2993181 ↗
21. 10.1021/acsami.0c0311010.1021/acsami.0c03110 ↗
22. 10.1002/advs.20190093910.1002/advs.201900939 ↗
23. 10.1149/2.0241907jes10.1149/2.0241907jes ↗
24. 10.1016/j.brs.2018.12.20610.1016/j.brs.2018.12.206 ↗
25. 10.1126/sciadv.aay172910.1126/sciadv.aay1729 ↗
26. 10.1038/s41467-022-33457-910.1038/s41467-022-33457-9 ↗
27. 10.1002/adma.20210586510.1002/adma.202105865 ↗
28. 10.3390/s1707148510.3390/s17071485 ↗
29. Lopez, A.; Ferrero, F. J.; Valledor, M.; Campo, J. C.; Postolache, O. A study on electrode placement in EOG systems for medical applications.IEEE International symposium on medical measurements and applications (MeMeA), 2016; IEEE, 2016; pp 1–5.10.1109/MeMeA.2016.7533703 ↗
30. Zhang, Y.F.; Gao, X.Y.; Zhu, J.Y.; Zheng, W.L.; Lu, B.L. A novel approach to driving fatigue detection using forehead EOG.7th International IEEE/EMBS Conference on Neural Engineering (NER), 2015; IEEE, 2015; pp 707–710.10.1109/NER.2015.7146721 ↗
31. 10.1109/tbme.2020.297577310.1109/tbme.2020.2975773 ↗
32. 10.1126/sciadv.160041810.1126/sciadv.1600418 ↗
33. 10.1002/adma.20170131210.1002/adma.201701312 ↗
34. 10.1038/s41746-017-0009-x10.1038/s41746-017-0009-x ↗
35. 10.1021/acsami.9b2023310.1021/acsami.9b20233 ↗
36. 10.1002/adma.20120442610.1002/adma.201204426 ↗
37. 10.1002/adhm.20140007310.1002/adhm.201400073 ↗
38. Merino, M.; Rivera, O.; Gómez, I.; Molina, A.; Dorronzoro, E. A method of EOG signal processing to detect the direction of eye movements.First International Conference on Sensor Device Technologies and Applications, 2010; IEEE, 2010; pp 100–105.10.1109/SENSORDEVICES.2010.25 ↗
39. Qiu, H.; Guo, Z.; Zhang, X. The design of FIR band-pass filter with improved distributed algorithm based on FPGA.International Conference on Multimedia Technology, 2010; IEEE, 2010; pp 1–4.10.1109/ICMULT.2010.5631230 ↗
40. Hayawi, A. A.; Waleed, J. Driver’s drowsiness monitoring and alarming auto-system based on EOG signals.2nd International Conference on Engineering Technology and its Applications (IICETA), 2019; IEEE, 2019; pp 214–218.10.1109/IICETA47481.2019.9013000 ↗
41. Syal, P.; Kumari, P. Comparative Analysis of KNN, SVM, DT for EOG based Human Computer Interface.International Conference on Current Trends in Computer, Electrical, Electronics and Communication (CTCEEC), 2017; IEEE, 2017; pp 1023–1028.10.1109/CTCEEC.2017.8455122 ↗
42. 10.20967/jcscm.2012.04.00410.20967/jcscm.2012.04.004 ↗
43. 10.3762/bjnano.12.1410.3762/bjnano.12.14 ↗
44. Vourvopoulos, A.; Niforatos, E.; Giannakos, M. EEGlass: An EEG-eyeware prototype for ubiquitous brain-computer interaction.Adjunct proceedings of the 2019 ACM international joint conference on pervasive and ubiquitous computing and proceedings of the 2019 ACM international symposium on wearable computers, 2019; pp 647–652.10.1145/3341162.3348383 ↗
45. Tabal, K. M.; Cruz, J. D. Development of low-cost embedded-based electrooculogram blink pulse classifier for drowsiness detection system.IEEE 13th International Colloquium on Signal Processing & its Applications (CSPA), 2017; IEEE, 2017; pp 29–34.10.1109/CSPA.2017.8064919 ↗
46. Vehkaoja, A. T.; Verho, J. A.; Puurtinen, M. M.; Nojd, N. M.; Lekkala, J. O.; Hyttinen, J. A. Wireless head cap for EOG and facial EMG measurements.IEEE Engineering in Medicine and Biology 27th Annual Conference, 2006; IEEE, 2005; pp 5865–5868.10.1109/IEMBS.2005.1615824 ↗
47. 10.3390/s2117588210.3390/s21175882 ↗
48. 10.1016/j.measurement.2018.06.01710.1016/j.measurement.2018.06.017 ↗
49. O’Bard, B.; Larson, A.; Herrera, J.; Nega, D.; George, K. Electrooculography based iOS controller for individuals with quadriplegia or neurodegenerative disease.IEEE International Conference on Healthcare Informatics (ICHI), 2017; IEEE, 2017; pp 101–106.10.1109/ICHI.2017.90 ↗