Imperceptible electrooculography graphene sensor system for human–robot interface
Source abstract
Abstract
Abstract Electrooculography (EOG) is a method to record the electrical potential between the cornea and the retina of human eyes. Despite many applications of EOG in both research and medical diagnosis for many decades, state-of-the-art EOG sensors are still bulky, stiff, and uncomfortable to wear. Since EOG has to be measured around the eye, a prominent area for appearance with delicate skin, mechanically and optically imperceptible EOG sensors are highly desirable. Here, we report an imperceptible EOG sensor system based on noninvasive graphene electronic tattoos (GET), which are ultrathin, ultrasoft, transparent, and breathable. The GET EOG sensors can be easily laminated around the eyes without using any adhesives and they impose no constraint on blinking or facial expressions. High-precision EOG with an angular resolution of 4° of eye movement can be recorded by the GET EOG and eye movement can be accurately interpreted. Imperceptible GET EOG sensors have been successfully applied for human–robot interface (HRI). To demonstrate the functionality of GET EOG sensors for HRI, we connected GET EOG sensors to a wireless transmitter attached to the collar such that we can use eyeball movements to wirelessly control a quadcopter in real time.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Neuroscience and Neural Engineering · Gaze Tracking and Assistive Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (63)
Show source-provided references
1. Bareket, L. et al. Temporary-tattoo for long-term high fidelity biopotential recordings. Sci. Rep. 6, 25727 (2016).10.1038/srep25727 ↗
2. Huang, X., Yeo, W. H., Liu, Y. & Rogers, J. A. Epidermal differential impedance sensor for conformal skin hydration monitoring. Biointerphases 7, 52 (2012).10.1007/s13758-012-0052-8 ↗
3. Kenry, Yeo, J. C. & Lim, C. T. Emerging flexible and wearable physical sensing platforms for healthcare and biomedical applications. Microsyst. Nanoeng. 2, 16043 (2016).10.1038/micronano.2016.43 ↗
4. Jeong, J. W. et al. Materials and optimized designs for human-machine interfaces via epidermal electronics. Adv. Mater. 25, 6839–6846 (2013).10.1002/adma.201301921 ↗
5. Gao, W. et al. Fully integrated wearable sensor arrays for multiplexed in situ perspiration analysis. Nature 529, 509–514 (2016).10.1038/nature16521 ↗
6. Nyein, H. Y. et al. A wearable electrochemical platform for noninvasive simultaneous monitoring of Ca(2+) and pH. ACS Nano 10, 7216–7224 (2016).10.1021/acsnano.6b04005 ↗
7. Metcalf, D., Milliard, S. T., Gomez, M. & Schwartz, M. Wearables and the internet of things for health: wearable, interconnected devices promise more efficient and comprehensive health care. IEEE Pulse 7, 35–39 (2016).10.1109/MPUL.2016.2592260 ↗
8. Lo, B. P. L., Ip, H. & Yang, G. Z. Transforming health care: body sensor networks, wearables, and the internet of things. IEEE Pulse 7, 4–8 (2016).10.1109/MPUL.2015.2498474 ↗
9. Kim, D.-H. et al. Epidermal electronics. Science 333, 838–843 (2011).10.1126/science.1206157 ↗
10. Bandodkar, A. J., Jia, W. & Wang, J. Tattoo-based wearable electrochemical devices: a review. Electroanal 27, 11 (2015).10.1002/elan.201400537 ↗
11. Webb, R. C. B. et al. Ultrathin conformal devices for precise and continuous thermal characterization of human skin. Nat. Mater. 12, 938–944 (2013).10.1038/nmat3755 ↗
12. Kim, J. et al. Battery-free, stretchable optoelectronic systems for wireless optical characterization of the skin. Sci. Adv. 2, e1600418 (2016).10.1126/sciadv.1600418 ↗
13. Jang, K. I. et al. Rugged and breathable forms of stretchable electronics with adherent composite substrates for transcutaneous monitoring. Nat. Commun. 5, 4779 (2014).10.1038/ncomms5779 ↗
14. Xu, S. et al. Soft microfluidic assemblies of sensors, circuits, and radios for the skin. Science 344, 70–74 (2014).10.1126/science.1250169 ↗
15. Koo, J. H. et al. Wearable electrocardiogram monitor using carbon nanotube electronics and color-tunable organic light-emitting diodes. ACS Nano 11, 10032–10041 (2017).10.1021/acsnano.7b04292 ↗
16. Araki, H. et al. Materials and device designs for an epidermal UV colorimetric dosimeter with near field communication capabilities. Adv. Funct. Mater. 27, 1604465 (2017).10.1002/adfm.201604465 ↗
17. Son, D. et al. Multifunctional wearable devices for diagnosis and therapy of movement disorders. Nat. Nanotechnol. 9, 397–404 (2014).10.1038/nnano.2014.38 ↗
18. Song, J.-K. et al. Wearable force touch sensor array using a flexible and transparent electrode. Adv. Funct. Mater. 27, 1605286 (2017).10.1002/adfm.201605286 ↗
19. Chortos, A., Liu, J. & Bao, Z. Pursuing prosthetic electronic skin. Nat. Mater. 15, 937–950 (2016).10.1038/nmat4671 ↗
20. Wang, S. et al. Mechanics of epidermal electronics. J. Appl. Mech. 79, 031022 (2012).10.1115/1.4005963 ↗
21. Wang, L. & Lu, N. Conformability of a thin elastic membrane laminated on a soft substrate with slightly wavy surface. J. Appl. Mech. 83, 041007 (2016).10.1115/1.4032466 ↗
22. Jeong, J. W. et al. Capacitive epidermal electronics for electrically safe, long-term electrophysiological measurements. Adv. Healthc. Mater. 3, 642–648 (2014).10.1002/adhm.201300334 ↗
23. Wang, Y. et al. Low-cost, μm-thick, tape-free electronic tattoo sensors with minimized motion and sweatartifacts. NPJ Flexible Electronics 6, 1–6 (2018).
24. Kaltenbrunner, M. et al. An ultra-lightweight design for imperceptible plastic electronics. Nature 499, 458–463 (2013).10.1038/nature12314 ↗
25. Melzer, M. et al. Imperceptible magnetoelectronics. Nat. Commun. 6, 6080 (2015).10.1038/ncomms7080 ↗
26. Hecht, D. S., Hu, L. & Irvin, G. Emerging transparent electrodes based on thin films of carbon nanotubes, graphene, and metallic nanostructures. Adv. Mater. 23, 1482–1513 (2011).10.1002/adma.201003188 ↗
27. Ellmer, K. Past achievements and future challenges in the development of optically transparent electrodes. Nat. Photonics 6, 809 (2012).10.1038/nphoton.2012.282 ↗
28. Akinwande, D. et al. A review on mechanics and mechanical properties of 2D materials—graphene and beyond. Extrem. Mech. Lett. 13, 42–77 (2017).10.1016/j.eml.2017.01.008 ↗
29. Xue, J. et al. Nanowire-based transparent conductors for flexible electronics and optoelectronics. Sci. Bull. 62, 143–156 (2017).10.1016/j.scib.2016.11.009 ↗
30. Song, J. & Zeng, H. Transparent electrodes printed with nanocrystal inks for flexible smart devices. Angew. Chem. 54, 9760–9774 (2015).10.1002/anie.201501233 ↗
31. Wang, Y. et al. A highly stretchable, transparent, and conductive polymer. Sci. Adv. 3, e1602076 (2017).10.1126/sciadv.1602076 ↗
32. Wang, L., Qiao, S., Ameri, S. K., Jeong, H. & Lu, N. A thin elastic membrane conformed to a soft and rough substrate subjected to stretching/compression. J. Appl. Mech. 84, 111003 (2017).10.1115/1.4037740 ↗
33. Shah, P., Narayanan, T. N., Li, C. Z. & Alwarappan, S. Probing the biocompatibility of MoS2 nanosheets by cytotoxicity assay and electrical impedance spectroscopy. Nanotechnology 26, 315102 (2015).10.1088/0957-4484/26/31/315102 ↗
34. Song, I., Park, C. & Choi, H. C. Synthesis and properties of molybdenum disulphide: from bulk to atomic layers. RSC Adv. 5, 7495–7514 (2015).10.1039/C4RA11852A ↗
35. Ameri, S. K. et al. Three dimensional graphene scaffold for cardiac tissue engineering and in-situ electrical recording. IEEE EMBC 3, 4201–4203 (2016).
36. Ameri, S. K., Singh, P. K. & Sonkusale, S. Utilization of graphene electrode in transparent microwell arrays for high throughput cell trapping and lysis. Biosens. Bioelectron. 61, 625–630 (2014).10.1016/j.bios.2014.05.067 ↗
37. Na, S. R. et al. Clean graphene interfaces by selective dry transfer for large area silicon integration. Nanoscale 8, 7523–7533 (2016).10.1039/C5NR06637A ↗
38. Pinto, A. M., Goncalves, I. C. & Magalhaes, F. D. Graphene-based materials biocompatibility: a review. Colloids Surf. B Biointerfaces 111, 188–202 (2013).10.1016/j.colsurfb.2013.05.022 ↗
39. Choi, M. K. et al. Thermally controlled, patterned graphene transfer printing for transparent and wearable electronic/optoelectronic system. Adv. Funct. Mater. 25, 7109–7118 (2015).10.1002/adfm.201502956 ↗
40. Lee, H. et al. A graphene-based electrochemical device with thermoresponsive microneedles for diabetes monitoring and therapy. Nat. Nanotechnol. 11, 566–572 (2016).10.1038/nnano.2016.38 ↗
41. Blees, M. K. et al. Graphene kirigami. Nature 524, 204–207 (2015).10.1038/nature14588 ↗
42. Park, M. et al. MoS2-based tactile sensor for electronic skin applications. Adv. Mater. 28, 2556–2562 (2016).10.1002/adma.201505124 ↗
43. Meitl, M. A. et al. Transfer printing by kinetic control of adhesion to an elastomeric stamp. Nat. Mater. 5, 33–38 (2006).10.1038/nmat1532 ↗
44. Ameri, S. K. et al. Graphene electronic tattoo sensors. ACS nano 11, 7634–7641 (2017).10.1021/acsnano.7b02182 ↗
45. Boukadoum, A. M. & Ktonas, P. Y. EOG-based recording and automated detection of sleep rapid eye movements: a critical review, and some recommendations. Psychophysiology 23, 598–611 (1986).10.1111/j.1469-8986.1986.tb00678.x ↗
46. Ding, Q., Tong, K. & Li, G. Development of an EOG (electro-oculography) based human-computer interface. Int. Conf. IEEE Eng. Med. Biol. 7, 6829–6831 (2005).
47. Nam, Y., Koo, B., Cichocki, A. & Choi, S. GOM-Face: GKP, EOG, and EMG-based multimodal interface with application to humanoid robot control. IEEE Trans. Bio Med. Eng. 61, 453–462 (2014).10.1109/TBME.2013.2280900 ↗
48. Rac-Lubashevsky, R., Slagter, H. A. & Kessler, Y. Tracking real-time changes in working memory updating and gating with the event-based eye-blink rate. Sci. Rep. 7, 2547 (2017).10.1038/s41598-017-02942-3 ↗
49. Lam, R. W., Beattie, C. W., Buchanan, A., Remick, R. A. & Zis, A. P. Low electrooculographic ratios in patients with seasonal affective disorder. Am. J. Psychiatry 148, 1526–1529 (1991).10.1176/ajp.148.8.1098-a ↗
50. Siddiqui, U. & Shaikh, A. N. An overview of “electrooculography”. Int. J. Adv. Res. Comput. Commun. Eng. 2, 3 (2013).
51. Dey, N. Classification and Clustering In Biomedical Signal Processing (IGI Global, Hershey, PA, 2016).10.4018/978-1-5225-0140-4 ↗
52. Bour, L., Visser, O. B., Aramideh, M. & Speelman, J. Origin of eye and eyelid movements during blinking. Mov. Disord. 17, S30–S32 (2002).10.1002/mds.10047 ↗
53. Yamagishi, K., Hori, J. & Miyakawa, M. Development of EOG-based communication system controlled by eight-directional eye movements. Int. Conf. IEEE Eng. Med. Biol. 1, 2574–2577 (2006).
54. Magosso, E., Ursino, M., Zaniboni, A., Provini, F. & Montagna, P. Visual and computer-based detection of slow eye movements in overnight and 24-h EOG recordings. Clin. Neurophysiol. 118, 1122–1133 (2007).10.1016/j.clinph.2007.01.014 ↗
55. Ubeda, A., Ianez, E. & Azorın, M. J. Wireless and portable EOG-based interface for assisting disabled people. IEEE/ASME Trans. Mechatron. 6, 4 (2011).
56. Bulling, A., Ward, J. A., Gellersen, H. & Troster, G. Eye movement analysis for activity recognition using electrooculography. IEEE Trans. Pattern Anal. Mach. Intell. 33, 741–753 (2011).10.1109/TPAMI.2010.86 ↗
57. Mélodie, J. T. V., Bulling, A. & Gellersen, H. Wearable eye tracking for mental health monitoring. Comput. Commun. 35, 6 (2012).
58. Barea, R., Boquete, L., Rodriguez-Ascariz, J. M., Ortega, S. & Lopez, E. Sensory system for implementing a human-computer interface based on electrooculography. Sensors 11, 310–328 (2011).10.3390/s110100310 ↗
59. Vehkaoja, A. T. et al. Wireless head cap for EOG and facial EMG measurements. Int. Conf. IEEE Eng. Med. Biol. 6, 5865–5868 (2005).
60. Searle, A. & Kirkup, L. A direct comparison of wet, dry and insulating bioelectric recording electrodes. Physiol. Meas. 21, 271–283 (2000).10.1088/0967-3334/21/2/307 ↗
61. Jang, K. I. et al. Self-assembled three dimensional network designs for soft electronics. Nat. Commun. 8, 15894 (2017).10.1038/ncomms15894 ↗
62. Merino, M., Gomez, I. M. & Molina, A. J. Envelope filter sequence to delete blinks and overshoots. BioMed. Eng. 14, 48 (2015).
63. Baek, C., Goo, Y. & Seo, J.-M. Real-time baseline wander removal from electrooculography using probabilistic baseline prediction. MBEC 45, 78–81 (2014).