Integration Between Serious Games and EEG Signals: A Systematic Review
Source abstract
Abstract
A serious game combines concepts, principles, and methods of game design with information and communication technologies for the achievement of a given goal beyond entertainment. Serious game studies have been reported under a brain–computer interface (BCI) approach, with the specific use of electroencephalographic (EEG) signals. This study presents a review of the technological solutions from existing works related to serious games and EEG signals. A taxonomy is proposed for the classification of the research literature in three different categories according to the experimental strategy for the integration of the game and EEG: (1) evoked signals, (2) spontaneous signals, and (3) hybrid signals. Some details and additional aspects of the studies are also reviewed. The analysis involves factors such as platforms and development languages (serious game), software tools (integration between serious game and EEG signals), and the number of test subjects. The findings indicate that 50% of the identified studies use spontaneous signals as the experimental strategy. Based on the definition, categorization, and state of the art, the main research challenges and future directions for this class of technological solutions are discussed.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: EEG and Brain-Computer Interfaces · Neural and Behavioral Psychology Studies · Gaze Tracking and Assistive Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Centro de Servicios y Gestión Empresarial, Servicio Nacional de Aprendizaje, Calle 51 No. 57-70, Medellín 050010, Colombia
Facultad de Ingeniería, Institución Universitaria Pascual Bravo, Cra. 73 73A 226, Medellín 050034, Colombia
Facultad de Estudios Empresariales y de Mercadeo, Institución Universitaria Esumer, Cra. 28 No. 19-24, Medellín 050035, Colombia
Facultad de Producción y Diseño, Institución Universitaria Pascual Bravo, Cra. 73 73A 226, Medellín 050034, Colombia
Funding
Institución Universitaria Pascual Bravo
References (80)
Show source-provided references
1. A review of virtual reality videogames for job-training applications10.33131/24222208.346 ↗
2. Chow, W., and Van Eeden, E. (2017). Global Entertainment & Media Outlook 2018–2022. PwC Global Entertainment & Media Outlook, PwC.
3. Jóvenes y videojuegos: Perspectivas sobre el consumo de videojuegos ambientados en Colombia
4. Bernal Marín, I. (Diario La República, 2022). Los Videojuegos ya se Han Vuelto una Necesidad Diaria Para 37% de los Colombianos, Diario La República.
5. El uso del videojuego y su relación en el sobrepeso en universitarios, Popayán, Colombia (The use of the video game and its relation to overweight in university students, Popayan, Colombia)10.47197/retos.v48.96638 ↗
6. El rendimiento escolar y el uso de videojuegos en estudiantes de básica secundaria del municipio de La Estrella- Antioquia
7. The association between owning a videogame console and the gender gap in STEM: An instrumental variable approach10.1007/s40692-022-00247-7 ↗
8. Comportamientos tóxicos en videojugadores de LoL latinoamericanos
9. Dörner, R., Göbel, S., Effelsberg, W., and Wiemeyer, J. (2016). Serious Games Application Examples. Serious Games, Springer International Publishing.10.1007/978-3-319-40612-1 ↗
10. Is game-based learning better in flow experience and various types of cognitive load than non-game-based learning? Perspective from multimedia and media richness10.1016/j.chb.2017.01.031 ↗
11. Game-based Learning and 21st century skills: A review of recent research10.1016/j.chb.2016.05.023 ↗
12. Literature Review: Learning Through Game-Based Technology Enhances Cognitive Skills
13. Toward a methodology for serious games design for children with auditory impairments10.1109/TLA.2016.7530453 ↗
14. Comparing interaction techniques for serious games through brain–computer interfaces: A user perception evaluation study10.1016/j.entcom.2014.10.004 ↗
15. García-Ramón, R.D., Rechy-Ramirez, E.J., Alonso-Valerdi, L.M., and Marin-Hernandez, A. (2024). Engagement Analysis Using Electroencephalography Signals in Games for Hand Rehabilitation with Dynamic and Random Difficulty Adjustments. Appl. Sci., 14.10.3390/app14188464 ↗
16. Su, H., Wang, S., Huang, M., Chen, Y., Lu, A., and Yang, R. (2023, January 9–10). VR and Exoskeleton Assisted Lower Limb Rehabilitation based on Motor Imagery BCI. Proceedings of the 2023 IEEE International Biomedical Instrumentation and Technology Conference (IBITeC), Yogyakarta, Indonesia.10.1109/IBITeC59006.2023.10390929 ↗
17. eeglib: Computational analysis of cognitive performance during the use of video games10.1007/s12652-019-01592-9 ↗
18. Alchalcabi, A.E., Eddin, A.N., and Shirmohammadi, S. (2017, January 2–4). More attention, less deficit: Wearable EEG-based serious game for focus improvement. Proceedings of the 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH), Perth, Australia.10.1109/SeGAH.2017.7939288 ↗
19. Sourina, O., Wortley, D., and Kim, S. (2015). EEG-Based Serious Games. Subconscious Learning via Games and Social Media, Springer.10.1007/978-981-287-408-5 ↗
20. Games, Gameplay, and BCI: The State of the Art10.1109/TCIAIG.2013.2263555 ↗
21. Neurophysiological methods for monitoring brain activity in serious games and virtual environments: A review10.1504/IJTEL.2014.060022 ↗
22. A Review of Brain-Computer Interface Games and an Opinion Survey from Researchers, Developers and Users10.3390/s140814601 ↗
23. EEG-based BCI and video games: A progress report10.1007/s10055-017-0328-x ↗
24. From visual simulation to virtual reality to games10.1109/MC.2005.297 ↗
25. Michael, D. (2006). Serious Games: Games That Educate, Train and Inform, Thomson Course Technology. OCLC: ocm62780159.
26. Playing for Real10.1016/j.amepre.2007.09.027 ↗
27. Alvarez, J., and Djaouti, D. (2011, January 5). An introduction to Serious game Definitions and concepts. Proceedings of the Serious Games & Simulation for Risks Management, Paris, France.
28. A Brief History of Serious Games10.1007/978-3-319-46152-6_2 ↗
29. Alvarez, J., Rampnoux, O., Jessel, J.P., and Méthel, G. (2007, January 2–5). Serious Game: Just a question of posture?. Proceedings of the 33rd Annual Convention of the Society for the Study of Artificial Intelligence and the Simulation of Behaviour (AISB 2007), Newcastle, UK.
30. Fauquet Alekhine, P. (2011). Human or Avatar: Psychological Dimensions on Full Scope, Hybrid, and Virtual Reality Simulators, Laboratory for Research in Science of Energy.
31. Cordeiro d’Ornellas, M., Cargnin, D.J., and Cervi Prado, A.L. (2014, January 12–14). Thoroughly Approach to Upper Limb Rehabilitation Using Serious Games for Intensive Group Physical Therapy or Individual Biofeedback Training. Proceedings of the 2014 Brazilian Symposium on Computer Games and Digital Entertainment, Porto Alegre, Brazil.10.1109/SBGAMES.2014.22 ↗
32. Rehabilitation Using Kinect-based Games and Virtual Reality10.1016/j.procs.2015.12.233 ↗
33. Collaborative open training with serious games: Relations, culture, knowledge, innovation, and desire10.1016/j.jik.2016.06.003 ↗
34. Nagashima, Y. (2016, January 7–9). Towards the Biofeedback Game—With Interoception and Rehabilitation. Proceedings of the 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES), Barcelona, Spain.10.1109/VS-GAMES.2016.7590372 ↗
35. EEG acquisition and processing for cognitive brain mapping during chess problem solving10.1109/TLA.2016.7459589 ↗
36. The anatomy and immunology of vasculature in the central nervous system10.1126/sciimmunol.aav0492 ↗
37. Elashmawi, W.H., Ayman, A., Antoun, M., Mohamed, H., Mohamed, S.E., Amr, H., Talaat, Y., and Ali, A. (2024). A Comprehensive Review on Brain–Computer Interface (BCI)-Based Machine and Deep Learning Algorithms for Stroke Rehabilitation. Appl. Sci., 14.10.3390/app14146347 ↗
38. Brain computer interfaces for communication and control10.1016/S1388-2457(02)00057-3 ↗
39. He, B., Gao, S., Yuan, H., and Wolpaw, J. (2013). Brain–computer interfaces. Neural Engineering, Springer Science+Business Media.10.1007/978-1-4614-5227-0_2 ↗
40. Brain computer interface: Control signals review10.1016/j.neucom.2016.10.024 ↗
41. Technical survey of end-to-end signal processing in BCIs using invasive MEAs10.1088/1741-2552/ad8031 ↗
42. Development of a Brain-Computer Interface Based on Visual Stimuli for the Movement of a Robot Joints10.1109/TLA.2016.7437182 ↗
43. Odor Pleasantness Classification from Electroencephalographic Signals and Emotional States10.1007/978-3-319-98998-3_10 ↗
44. Analysis of Motor Imaginary BCI Within Multi-environment Scenarios Using a Mixture of Classifiers10.1007/978-3-319-66562-7_37 ↗
45. A Prototype SSVEP Based Real Time BCI Gaming System
46. Webster, J.G. (2015). Electroencephalography (EEG)-Based Brain–Computer Interfaces. Wiley Encyclopedia of Electrical and Electronics Engineering, Wiley. [1st ed.].
47. Graimann, B., Pfurtscheller, G., and Allison, B. (2009). Brain Computer Interfaces: A Gentle Introduction. Brain-Computer Interfaces, Springer.10.1007/978-3-642-02091-9 ↗
48. Real-Time Control of a Video Game Using Eye Movements and Two Temporal EEG Sensors10.1155/2015/653639 ↗
49. Motor Imagery EEG Signal Processing and Classification using Machine Learning Approach
50. AlEssa, G.N., and Alzahrani, S.I. (2024). EEG-Based Methods for Diagnosing Color Vision Deficiency: A Comprehensive Review. Appl. Sci., 14.10.3390/app14177579 ↗
51. Wang, Q., Sourina, O., and Nguyen, M.K. (2010, January 20–22). EEG-Based “Serious” Games Design for Medical Applications. Proceedings of the 2010 International Conference on Cyberworlds, Singapore.10.1109/CW.2010.56 ↗
52. Mecarelli, O. (2019). Neurophysiological Basis of EEG. Clinical Electroencephalography, Springer International Publishing.10.1007/978-3-030-04573-9 ↗
53. Fundamentals of EEG measurement
54. Larsen, E.A. (2011). Classification of EEG Signals in a Brain Computer Interface Sys. [Ph.D. Thesis, Norwegian University of Science and Technology].
55. Phenotyping Ex-Combatants From EEG Scalp Connectivity10.1109/ACCESS.2018.2872765 ↗
56. Oikonomou, V.P., Georgiadis, K., Liaros, G., Nikolopoulos, S., and Kompatsiaris, I. (2017, January 22–24). A Comparison Study on EEG Signal Processing Techniques Using Motor Imagery EEG Data. Proceedings of the 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS), Thessaloniki, Greece.10.1109/CBMS.2017.113 ↗
57. Singala, K.V., and Trivedi, K.R. (2016, January 6–8). Connection setup of openvibe tool with EEG headset, parsing and processing of EEG signals. Proceedings of the 2016 International Conference on Communication and Signal Processing (ICCSP), Melmaruvathur, India.10.1109/ICCSP.2016.7754278 ↗
58. Kawala Janik, A. (2013). Efficiency Evaluation of External Environments Control Using Bio-Signals. [Ph.D. Thesis, University of Greenwiich].
59. EEG Signals Classification: Motor Imagery for Driving an Intelligent Wheelchair10.1109/TLA.2018.8291481 ↗
60. Electroencephalographic Signals and Emotional States for Tactile Pleasantness Classification
61. Low Data Fusion Framework Oriented to Information Quality for BCI Systems10.1007/978-3-319-78759-6_27 ↗
62. Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming nvironment10.1155/ASP.2005.3156 ↗
63. Van Vliet, M., Robben, A., Chumerin, N., Manyakov, N.V., Combaz, A., and Van Hulle, M.M. (2012, January 9–11). Designing a brain-computer interface controlled video-game using consumer grade EEG hardware. Proceedings of the 2012 ISSNIP Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living (BRC), Manaus, Brazil.10.1109/BRC.2012.6222186 ↗
64. Khong, A., Jiangnan, L., Thomas, K.P., and Vinod, A.P. (2014, January 5–8). BCI based multi-player 3-D game control using EEG for enhancing attention and memory. Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), San Diego, CA, USA.10.1109/SMC.2014.6974189 ↗
65. Kawala-Janik, A., Podpora, M., Gardecki, A., Czuczwara, W., Baranowski, J., and Bauer, W. (2015, January 24–27). Game controller based on biomedical signals. Proceedings of the 2015 20th International Conference on Methods and Models in Automation and Robotics (MMAR), Miedzyzdroje, Poland.10.1109/MMAR.2015.7284003 ↗
66. Correlation between videogame mechanics and executive functions through EEG analysis10.1016/j.jbi.2016.08.006 ↗
67. Delisle-Rodriguez, D., De Oliveira, H.L., Da Silva, J.C., De Souza, M.L., Bastos, T., Nakamura-Palacios, E.M., and Frizera-Neto, A. (2023). Multi-channel EEG-based BCI using regression and classification methods for attention training by serious game. Biomed. Signal Process. Control, 85.10.1016/j.bspc.2023.104937 ↗
68. Brain activity: Beta wave analysis of 2D and 3D serious games using EEG10.1515/jamsi-2017-0008 ↗
69. EEG correlates of video game experience and user profile in motor-imagery-based brain–computer interaction10.1007/s00371-016-1304-2 ↗
70. Electroencephalography (EEG)-Based Brain–Computer Interface (BCI): A 2-D Virtual Wheelchair Control Based on Event-Related Desynchronization/Synchronization and State Control10.1109/TNSRE.2012.2190299 ↗
71. Hawsawi, O., and Semwal, S.K. (2014, January 5–8). EEG headset supporting mobility impaired gamers with game accessibility. Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), San Diego, CA, USA.10.1109/SMC.2014.6974015 ↗
72. Munoz, J.E., Chavarriaga, R., Villada, J.F., and SebastianLopez, D. (2014, January 10–13). BCI and motion capture technologies for rehabilitation based on videogames. Proceedings of the IEEE Global Humanitarian Technology Conference (GHTC 2014), San Jose, CA, USA.10.1109/GHTC.2014.6970312 ↗
73. A Review of Hybrid Brain-Computer Interface Systems
74. Noninvasive Brain-Computer Interfaces Based on Sensorimotor Rhythms10.1109/JPROC.2015.2407272 ↗
75. Brain computer interface technology: A review of the first international meeting10.1109/TRE.2000.847807 ↗
76. Dharmasena, S., Lalitharathne, K., Dissanayake, K., Sampath, A., and Pasqual, A. (2013, January 17–20). Online classification of imagined hand movement using a consumer grade EEG device. Proceedings of the 2013 IEEE 8th International Conference on Industrial and Information Systems, Peradeniya, Sri Lanka.10.1109/ICIInfS.2013.6732041 ↗
77. Han, C.H., Lim, J.H., Lee, J.H., Kim, K., and Im, C.H. (2016). Data-Driven User Feedback: An Improved Neurofeedback Strategy considering the Interindividual Variability of EEG Features. BioMed Res. Int., 2016.10.1155/2016/3939815 ↗
78. Towards an independent brain–computer interface using steady state visual evoked potentials10.1016/j.clinph.2007.09.121 ↗
79. Vourvopoulos, A., Liarokapis, F., and Chen, M.C. (2015, January 16–18). The Effect of Prior Gaming Experience in Motor Imagery Training for Brain-Computer Interfaces: A Pilot Study. Proceedings of the 2015 7th International Conference on Games and Virtual Worlds for Serious Applications (VS-Games), Skövde, Sweden.10.1109/VS-GAMES.2015.7295789 ↗
80. Serious game for real-time brain-computer interface training10.1088/1742-6596/1418/1/012011 ↗