Facial muscle mapping and expression prediction using a conformal surface-electromyography platform
Source abstract
Abstract
Abstract Facial muscles are uniquely attached to the skin, densely innervated, and exhibit complex co-activation patterns enabling fine motor control. Facial surface Electromyography (sEMG) effectively assesses muscle function, yet traditional setups require precise electrode placement and limit mobility due to mechanical artifacts. Signal extraction is hindered by noise and cross-talk from adjacent muscles, making it challenging to associate facial muscle activity with expressions. We leverage a novel 16-channel conformal sEMG system to extract meaningful electrophysiological data from 32 healthy individuals. By applying denoising and source separation techniques, we extracted independent components, clustered them spatially, and built a facial muscle atlas. Furthermore, we established a functional mapping between these clusters and specific muscle units, providing a framework for understanding facial muscle activation. Using this foundation, we demonstrated a deep-learning model to predict facial expressions. This approach enables precise, participant-specific monitoring with applications in medical rehabilitation and psychological research.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Facial Nerve Paralysis Treatment and Research · Hand Gesture Recognition Systems · Gaze Tracking and Assistive Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (50)
Show source-provided references
1. Perusquía-Hernández, M., Ayabe-Kanamura, S., Suzuki, K. & Kumano, S. The invisible potential of facial electromyography: a comparison of EMG and computer vision when distinguishing posed from spontaneous smiles. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–9 (Association for Computing Machinery, 2019).10.1145/3290605.3300379 ↗
2. Gat, L., Gerston, A., Shikun, L., Inzelberg, L. & Hanein, Y. Similarities and disparities between visual analysis and high-resolution electromyography of facial expressions. PLoS ONE 17, 1–14 (2022).10.1371/journal.pone.0262286 ↗
3. Seddon, H. J. Three types of nerve injury. Brain 66, 237–288 (1943).10.1093/brain/66.4.237 ↗
4. Guntinas-Lichius, O. et al. Facial nerve electrodiagnostics for patients with facial palsy: a clinical practice guideline. Eur. Arch. Otorhinolaryngol. 277, 1855–1874 (2020).10.1007/s00405-020-05949-1 ↗
5. Grosheva, M., Wittekindt, C. & Guntinas-Lichius, O. Prognostic value of electroneurography and electromyography in facial palsy. Laryngoscope 118, 394–397 (2008).10.1097/MLG.0b013e31815d8e68 ↗
6. Schumann, N. P., Bongers, K., Guntinas-Lichius, O. & Scholle, H. C. Facial muscle activation patterns in healthy male humans: a multi-channel surface EMG study. J. Neurosci. Methods 187, 120–128 (2010).10.1016/j.jneumeth.2009.12.019 ↗
7. Achaibou, A., Pourtois, G., Schwartz, S. & Vuilleumier, P. Simultaneous recording of EEG and facial muscle reactions during spontaneous emotional mimicry. Neuropsychologia 46, 1104–1113 (2008).10.1016/j.neuropsychologia.2007.10.019 ↗
8. Fridlund, A. J., Schwartz, G. E. & Fowler, S. C. Pattern recognition of self-reported emotional state from multiple-site facial EMG activity during affective imagery. Psychophysiology 21, 622–637 (1984).10.1111/j.1469-8986.1984.tb00249.x ↗
9. Argaud, S. et al. Does facial amimia impact the recognition of facial emotions? An EMG study in parkinson’s disease. PLoS One 11, e0160329 (2016).10.1371/journal.pone.0160329 ↗
10. Sajid, M. et al. Automatic grading of palsy using asymmetrical facial features: a study complemented by new solutions. Symmetry 10, 242 (2018).10.3390/sym10070242 ↗
11. Mothes, O. et al. Automated objective and marker-free facial grading using photographs of patients with facial palsy. Eur. Arch. Otorhinolaryngol. 276, 3335–3343 (2019).10.1007/s00405-019-05647-7 ↗
12. Buchner, T., Sickert, S., Volk, G. F., Guntinas-Lichius, O. & Denzler, J. Automatic objective severity grading of peripheral facial palsy using 3d radial curves extracted from point clouds. Stud. Health Technol. Inf. 294, 179–183 (2022).
13. Volk, G. F. et al. Effect of an intensified combined electromyography and visual feedback training on facial grading in patients with post-paralytic facial synkinesis. Front. Rehabilit. Sci. 2, 746188 (2021).10.3389/fresc.2021.746188 ↗
14. Trentzsch, V. et al. Test-retest reliability of high-resolution surface electromyographic activities of facial muscles during facial expressions in healthy adults: a prospective observational study. Front. Hum. Neurosci. 17, 1126336 (2023).10.3389/fnhum.2023.1126336 ↗
15. Funk, P. F. et al. Wireless high-resolution surface facial electromyography mask for discrimination of standardized facial expressions in healthy adults. Sci. Rep. 14, 19317 (2024).10.1038/s41598-024-70205-z ↗
16. Levit, B., Klorfeld-Auslender, S. & Hanein, Y. Wearable facial electromyography: in the face of new opportunities. Prog. Biomed. Eng. 5, 043001 (2023).10.1088/2516-1091/ace508 ↗
17. Arche-Núñez, A. et al. Bio-potential noise of dry printed electrodes: physiology versus the skin-electrode impedance. Physiol. Meas. 44, 095006 (2023).10.1088/1361-6579/acf2e7 ↗
18. Koh, T. J. & Grabiner, M. D. Evaluation of methods to minimize cross talk in surface electromyography. J. Biomech. 26, 151–7 (1993).10.1016/0021-9290(93)90086-T ↗
19. Inzelberg, L., David-Pur, M., Gur, E. & Hanein, Y. Multi-channel electromyography-based mapping of spontaneous smiles. J. Neural Eng. 17, 026025 (2020).10.1088/1741-2552/ab7c18 ↗
20. Oz, S. et al. Monitoring sleep stages with a soft electrode array: comparison against vPSG and home-based detection of REM sleep without atonia. J. Sleep. Res. 32, e13909 (2023).10.1111/jsr.13909 ↗
21. Ibrahim, R., Ketko, I., Scheinowitz, M. & Hanein, Y. Facial electromyography during exercise using soft electrode array: a feasibility study. PLoS One 19, e0298304 (2024).10.1371/journal.pone.0298304 ↗
22. Wang, Y. et al. Standing enokitake-like nanowire films for highly stretchable elastronics. ACS Nano 12, 9742–9749 (2018).10.1021/acsnano.8b05019 ↗
23. Wang, Y. et al. A durable nanomesh on-skin strain gauge for natural skin motion monitoring with minimum mechanical constraints. Sci. Adv. 6, eabb7043 (2020).10.1126/sciadv.abb7043 ↗
24. Inzelberg, L., Rand, D., Steinberg, S., David-Pur, M. & Hanein, Y. A wearable high-resolution facial electromyography for long term recordings in freely behaving humans. Sci. Rep. 8, 2058 (2018).10.1038/s41598-018-20567-y ↗
25. Possti, D. et al. Semi automatic quantification of REM sleep without atonia in natural sleep environment. npj Digital Med. 7, 341 (2024).10.1038/s41746-024-01354-8 ↗
26. Ruttimann, U. E. et al. Statistical analysis of functional MRI data in the wavelet domain. IEEE Trans. Med. imaging 17, 142–154 (1998).10.1109/42.700727 ↗
27. Jenkal, W. et al. An efficient algorithm of ECG signal denoising using the adaptive dual threshold filter and the discrete wavelet transform. Biocybern. Biomed. Eng. 36, 499–508 (2016).10.1016/j.bbe.2016.04.001 ↗
28. Ouyang, C., Cai, L., Liu, B. & Zhang, T. An improved wavelet threshold denoising approach for surface electromyography signal. EURASIP J. Adv. Signal Process. 2023, 108 (2023).10.1186/s13634-023-01066-3 ↗
29. Safieddine, D. et al. Removal of muscle artifact from EEG data: comparison between stochastic (ICA and CCA) and deterministic (EMD and wavelet-based) approaches. EURASIP J. Adv. Signal Process. 2012, 1–15 (2012).10.1186/1687-6180-2012-127 ↗
30. Zhou, W. & Gotman, J. Removal of EMG and ECG artifacts from EEG based on wavelet transform and ICA. In The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol. 1, 392–395 (IEEE, 2004).
31. Alyasseri, Z. A. A., Khader, A. T., Al-Betar, M. A., Abasi, A. K. & Makhadmeh, S. N. Eeg signals denoising using optimal wavelet transform hybridized with efficient metaheuristic methods. IEEE Access 8, 10584–10605 (2019).10.1109/ACCESS.2019.2962658 ↗
32. Kaur, C., Singh, P. & Sahni, S. Eeg artifact removal system for depression using a hybrid denoising approach. Basic Clin. Neurosci. 12, 465 (2021).10.32598/bcn.2021.1388.2 ↗
33. Patil, S. S. & Pawar, M. K. Quality advancement of eeg by wavelet denoising for biomedical analysis. In 2012 International Conference on Communication, Information & Computing Technology (ICCICT), 1–6 (IEEE, 2012).10.1109/ICCICT.2012.6398151 ↗
34. Sai, C. Y., Mokhtar, N., Arof, H., Cumming, P. & Iwahashi, M. Automated classification and removal of EEG artifacts with SVM and wavelet-ICA. IEEE J. Biomed. Health Inform. 22, 664–670 (2017).10.1109/JBHI.2017.2723420 ↗
35. Azzerboni, B., Carpentieri, M., La Foresta, F. & Morabito, F. Neural-ICA and wavelet transform for artifacts removal in surface EMG. In 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No. 04CH37541), vol. 4, 3223–3228 (IEEE, 2004).10.1109/IJCNN.2004.1381194 ↗
36. Büchner, T., Anders, C., Guntinas-Lichius, O. & Denzler, J. Electromyography-informed facial expression reconstruction for physiological-based synthesis and analysis. Preprint at https://arxiv.org/abs/2503.09556 (2025).10.1109/CVPR52734.2025.00029 ↗
37. Mueller, N. et al. High-resolution surface electromyographic activities of facial muscles during mimic movements in healthy adults: a prospective observational study. Front. Hum. Neurosci. 16, 1029415 (2022).10.3389/fnhum.2022.1029415 ↗
38. Paul, E. & Harriet, O. Facial expressions of emotion. Annu. Rev. Psychol. 30, 52–554 (1979).
39. Du, X. et al. Characteristics of facial muscle activity intensity in patients with schizophrenia and its relationship to negative symptoms. Front. Psychiatry 13, 829363 (2022).10.3389/fpsyt.2022.829363 ↗
40. Gehricke, J.-G. & Shapiro, D. Reduced facial expression and social context in major depression: discrepancies between facial muscle activity and self-reported emotion. Psychiatry Res. 95, 157–167 (2000).10.1016/S0165-1781(00)00168-2 ↗
41. Peirce, J. et al. Psychopy2: experiments in behavior made easy. Behav. Res. Methods 51, 195–203 (2019).10.3758/s13428-018-01193-y ↗
42. Schaede, R. A. et al. Patienten-instruktionsvideo mit synchroner videoaufnahme von gesichtsbewegungen bei fazialisparese. Laryngo Rhino Otologie 95, 844–849 (2017).
43. Volk, G. F. et al. Reliability of grading of facial palsy using a video tutorial with synchronous video recording. Laryngoscope 129, 2274–2279 (2019).10.1002/lary.27739 ↗
44. Virtanen, P. et al. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nat. Methods 17, 261–272 (2020).10.1038/s41592-019-0686-2 ↗
45. Lee, G., Gommers, R., Waselewski, F., Wohlfahrt, K. & O’Leary, A. Pywavelets: a Python package for wavelet analysis. J. Open Source Softw. 4, 1237 (2019).10.21105/joss.01237 ↗
46. Comon, P. Independent component analysis, a new concept? Signal Process. 36, 287–314 (1994).10.1016/0165-1684(94)90029-9 ↗
47. Pignat, J. M. et al. The impact of denoising on independent component analysis of functional magnetic resonance imaging data. J. Neurosci. Methods 213, 105–122 (2013).10.1016/j.jneumeth.2012.10.011 ↗
48. Ablin, P., Cardoso, J.-F. & Gramfort, A. Faster independent component analysis by preconditioning with Hessian approximations. IEEE Trans. Signal Process. 66, 4040–4049 (2018).10.1109/TSP.2018.2844203 ↗
49. Ablin, P., Cardoso, J.-F. & Gramfort, A. Faster ICA under orthogonal constraint. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 4464–4468 (IEEE, 2018).10.1109/ICASSP.2018.8461662 ↗
50. MacQueen, J. Some methods for classification and analysis of multivariant observations. In Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, 281–297 (University of California Press, 1967).