Enhancing Player Experience in a First-Person Shooter with Dynamic Audio Cue Adjustment Based on Gaussian Progress Regression
Source abstract
Abstract
This paper analyzes the experience of first-person shooter (FPS) players when game difficulty is adjusted by personalizing their audio cue settings, considering the balance between player performance, modeled using Gaussian process regression (GPR), and prior data serving as designer preference. In addition, we investigate why player experience changes according to in-game audio cues. Previous studies have proposed various dynamic difficulty adjustment (DDA) methods for FPS games. However, few studies have considered the role of audio cues in the player experience. This paper compares the player experience of personalized enemy audio cue volume settings (GPR-DDA) with that of predetermined settings in an FPS game. Two comprehensive experimental phases, involving 80 participants, are conducted to assess the efficacy of GPR-DDA. The experience of our players is measured using questions taken from the Game User Experience Satisfaction Scale (GUESS) questionnaire and a final survey asking for their open-ended feedback. A large language model (LLM) is used to analyze the natural language expressions of the players according to their native languages. To ensure the LLM effectively assists a limited number of qualified human evaluators in classifying player responses, we have developed an original procedure for this task. The GUESS results show that GPR-DDA can improve the player experience. In addition, the high consistency in the classification results over multiple runs of the selected LLM, as well as the similarity between its results and those of our human evaluators, reflects the reliability of the proposed LLM-assisted procedure.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Video Analysis and Summarization · Human Motion and Animation · Human Pose and Action Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Graduate School of Information Science and Engineering, Ritsumeikan University, 2-150 Iwakura-cho, Ibaraki, Osaka 567-8570, Japan
Department of Information Engineering, University of Florence, 50139 Florence, Italy
College of Information Science and Engineering, Ritsumeikan University, 2-150 Iwakura-cho, Ibaraki, Osaka 567-8570, Japan
References (40)
Show source-provided references
1. The interplay between immersion and appeal in video games10.1016/j.chb.2013.11.018 ↗
2. Johanson, C., and Mandryk, R.L. (2016, January 7–12). Scaffolding player location awareness through audio cues in first-person shooters. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.10.1145/2858036.2858172 ↗
3. Grimshaw, M., Tan, S.L., and Lipscomb, S.D. (2013). Playing with sound: The role of music and sound effects in gaming. The Psychology of Music in Multimedia, Oxford University Press.10.1093/acprof:oso/9780199608157.003.0013 ↗
4. Ribeiro, G., Rogers, K., Altmeyer, M., Terkildsen, T., and Nacke, L.E. (2020, January 2–4). Game atmosphere: Effects of audiovisual thematic cohesion on player experience and psychophysiology. Proceedings of the Annual Symposium on Computer-Human Interaction in Play, Virtual.10.1145/3410404.3414245 ↗
5. Audio influence on game atmosphere during various game events10.1016/j.procs.2021.01.001 ↗
6. Rogers, K., Ribeiro, G., Wehbe, R.R., Weber, M., and Nacke, L.E. (2018, January 21–26). Vanishing importance: Studying immersive effects of game audio perception on player experiences in virtual reality. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada.10.1145/3173574.3173902 ↗
7. Eames, A. (2019, January 14–16). Beyond Reality. Proceedings of the 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry, Brisbane, QLD, Australia. VRCAI ’19.10.1145/3359997.3365736 ↗
8. Gilberto, L.G., Bermejo, F., Tommasini, F.C., and García Bauza, C. (ACM Trans. Appl. Percept., 2023). Virtual Reality Audio Game for Entertainment & Sound Localization Training, ACM Trans. Appl. Percept., accepted.10.1145/3676557 ↗
9. FreesoundVR: Soundscape composition in virtual reality using online sound repositories10.1007/s10055-022-00705-8 ↗
10. Li, X., Wira, M., and Thawonmas, R. (2022, January 1). Toward Dynamic Difficulty Adjustment with Audio Cues by Gaussian Process Regression in a First-Person Shooter. Proceedings of the International Conference on Entertainment Computing, Bremen, Germany.10.1007/978-3-031-20212-4_12 ↗
11. Rethinking dynamic difficulty adjustment for video game design10.1016/j.entcom.2024.100663 ↗
12. The development and validation of the game user experience satisfaction scale (GUESS)10.1177/0018720816669646 ↗
13. A survey on evaluation of large language models10.1145/3641289 ↗
14. Artificial hallucinations in ChatGPT: Implications in scientific writing
15. Hufschmitt, A., Cardon, S., Borel, J., Wolf, F., and Addoum, M. (2024, January 5–8). Adaptive Audio to Player Actions and Gameplay: A New Video Game. Proceedings of the 2024 IEEE Conference on Games (CoG), Milan, Italy.10.1109/CoG60054.2024.10645554 ↗
16. Dynamic Music at the Macro and Micro Levels: A Comparison of The Pathless (2020) and Tchia (2023)10.1525/jsmg.2024.5.4.58 ↗
17. Mullen, T., Khalil, A., Ward, T., Iversen, J., Leslie, G., Warp, R., Whitman, M., Minces, V., McCoy, A., and Ojeda, A. (2015). MindMusic: Playful and social installations at the interface between music and the brain. More Playful User Interfaces: Interfaces That Invite Social and Physical Interaction, Springer.10.1007/978-981-287-546-4_9 ↗
18. Embracing Applied Behavior Analysis on a Serious Game Design Document Model10.1109/ACCESS.2023.3289857 ↗
19. Cai, Y., Liu, Z., Yang, Z., Tan, Y., Zhang, J., and Tang, S. (November, January 29). Starrypia: An AR Gamified Music Adjuvant Treatment Application for Children with Autism Based on Combined Therapy. Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, San Francisco, CA, USA.
20. Modeling and adjusting in-game difficulty based on facial expression analysis10.1016/j.entcom.2019.100307 ↗
21. Diversifying dynamic difficulty adjustment agent by integrating player state models into Monte-Carlo tree search10.1016/j.eswa.2022.117677 ↗
22. Pfau, J., Liapis, A., Volkmar, G., Yannakakis, G.N., and Malaka, R. (2020, January 24–27). Dungeons & replicants: Automated game balancing via deep player behavior modeling. Proceedings of the 2020 IEEE Conference on Games (CoG), Osaka, Japan.10.1109/CoG47356.2020.9231958 ↗
23. Khajah, M.M., Roads, B.D., Lindsey, R.V., Liu, Y.E., and Mozer, M.C. (2016, January 7–12). Designing engaging games using Bayesian optimization. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.10.1145/2858036.2858253 ↗
24. Gonzalez-Duque, M., Palm, R.B., and Risi, S. (2021, January 17–20). Fast game content adaptation through Bayesian-based player modelling. Proceedings of the 2021 IEEE Conference on Games (CoG), Copenhagen, Denmark.10.1109/CoG52621.2021.9619018 ↗
25. Chanel, G., Rebetez, C., Bétrancourt, M., and Pun, T. (2008, January 7–9). Boredom, engagement and anxiety as indicators for adaptation to difficulty in games. Proceedings of the 12th International Conference on Entertainment and Media in the Ubiquitous Era, Tampere, Finland.10.1145/1457199.1457203 ↗
26. Constant, T., and Levieux, G. (2019, January 4–9). Dynamic difficulty adjustment impact on players’ confidence. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK.10.1145/3290605.3300693 ↗
27. Bostan, B., and Öğüt, S. (2009, January 15–21). In pursuit of optimal gaming experience: Challenges and difficulty levels. Proceedings of the Entertainment= Emotion, ed PVMT Soto. Communication présentée à l’Entertainment=Emotion Conference (Benasque: Centro de Ciencias de Benasque Pedro Pascual (CCBPP)), Citeseer, Benasque, Spain.
28. An investigation of the effects of game difficulty on player enjoyment10.1016/j.entcom.2012.09.001 ↗
29. User experience with dynamic difficulty adjustment methods for an affective exergame: Comparative laboratory-based study10.2196/25771 ↗
30. Vassileva, D., and Bontchev, B. (2018, January 2–4). Dynamic game adaptation based on detection of behavioral patterns in the player learning curve. Proceedings of the EDULearn18: 10th annual International Conference on Education and New Learning Technologies, IATED Academy, Palma, Spain.
31. GomezRomero-Borquez, J., Del-Valle-Soto, C., Del-Puerto-Flores, J.A., Briseño, R.A., and Varela-Aldás, J. (2024). Neurogaming in Virtual Reality: A Review of Video Game Genres and Cognitive Impact. Electronics, 13.10.3390/electronics13091683 ↗
32. Baldwin, A., Johnson, D., and Wyeth, P. (2016, January 16–19). Crowd-pleaser: Player perspectives of multiplayer dynamic difficulty adjustment in video games. Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play, Austin, TX, USA.10.1145/2967934.2968100 ↗
33. Language Models are Few-Shot Learners
34. Zhao, W.X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., and Dong, Z. (2023). A survey of large language models. arXiv.
35. A brief overview of ChatGPT: The history, status quo and potential future development10.1109/JAS.2023.123618 ↗
36. Li, X., You, X., Chen, S., Taveekitworachai, P., and Thawonmas, R. (2023). Analyzing Audience Comments: Improving Interactive Narrative with ChatGPT. Interactive Storytelling, Springer.10.1007/978-3-031-47658-7_20 ↗
37. Lanzi, P.L., and Loiacono, D. (2023, January 15–19). Chatgpt and other large language models as evolutionary engines for online interactive collaborative game design. Proceedings of the Genetic and Evolutionary Computation Conference, Lisbon, Portugal.10.1145/3583131.3590351 ↗
38. Nimpattanavong, C., Taveekitworachai, P., Khan, I., Nguyen, T.V., Thawonmas, R., Choensawat, W., and Sookhanaphibarn, K. (2023, January 6–9). Am I fighting well? fighting game commentary generation with ChatGPT. Proceedings of the 13th International Conference on Advances in Information Technology, Bangkok, Thailand.10.1145/3628454.3629551 ↗
39. Zhang, L., Schlaghecken, F., Harte, J., and Roberts, K.L. (2021). The influence of the type of background noise on perceptual learning of speech in noise. Front. Neurosci., 15.10.3389/fnins.2021.646137 ↗
40. Extended match time exacerbates fatigue and impacts physiological responses in male soccer players10.1249/MSS.0000000000003021 ↗