A Long/Short-Term Memory Based Automated Testing Model to Quantitatively Evaluate Game Design
Source abstract
Abstract
The mobile casual game application lifespan is getting shorter. A company has to shorten the game testing procedure to avoid being squeezed out of the game market share. There is no sufficient testing indicator to objectively evaluate the operability of different game designs. Many automated testing methodologies are proposed, but they adopt rule-based approaches and cannot provide quantitative analysis to statistically evaluate gameplay experience. This study suggests applying “Learning Time” as a testing indicator and using the learning curve to identify the operability of different game designs. This study also proposes a Long/Short-Term Memory based automated testing model (called LSTM-Testing) to statistically testing game experience through end-to-end functionality (Input: game image; Output: game action) without any manual intervention. The experiment results demonstrate LSTM-Testing can provide quantitative testing data by using learning time as the control variable, game design as the independent variable, and time to complete game as the dependent variable. This study also demonstrates how LSTM-Testing evaluates the effectiveness of different gameplay learning strategies, e.g., reviewing the newest decisions, reviewing the correct decision, or reviewing the wrong decisions. The contributions of LSTM-Testing are (1) providing an objective and quantitative analytical game-testing framework, (2) reducing the labor cost of inefficient and subjective manual game testing, and (3) allowing game company boosts software development by focusing on game intellectual property and leaves game testing to artificial intelligence (AI).
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Artificial Intelligence in Games · Sports Analytics and Performance · Educational Games and Gamification
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Mathematics and Applied Mathematics (Finance and Statistics), School of Information Engineering, SanMing University, SanMing 365004, China
Department of Information Management, National Taipei University of Nursing and Health Sciences, Taipei 112, Taiwan
Department of Nursing, National Taipei University of Nursing and Health Sciences, Taipei 112, Taiwan
Department of Business Administration, Shih Hsin University, Taipei 116, Taiwan
References (13)
Show source-provided references
1. (2020, June 23). Clairfiled International, Gaming Industry-Facts, Figures and Trends Clairfield International. Available online: http://www.clairfield.com/wp-content/uploads/2017/02/Gaming-Industry-and-Market-Report-2018.01-2.pdf.
2. Lu, J.-Y., Dai, W.-S., Tang, Y.-X., and Su, A.-S. (2016, January 22–23). Game app life cycle and user immersion experience. Proceedings of the Conference on Information Technology and Applications in Outlying Islands, Kaohsiung, Taiwan. Available online: http://csie.npu.edu.tw/Seminar/15/15/paper/P1-35.pdf.
3. An approach to automated videogame beta testing10.1016/j.entcom.2016.08.002 ↗
4. Player-centered game AI from a flow perspective: Towards a better understanding of past trends and future directions10.1016/j.entcom.2017.02.003 ↗
5. Dynamic difficulty adjustment on MOBA games10.1016/j.entcom.2016.10.002 ↗
6. Wheat, D., Masek, M., Lam, C.P., and Hingston, P. (2015, January 9–12). Dynamic difficulty adjustment in 2D platformers through agent-based procedural level generation. Proceedings of the 2015 IEEE International Conference on Systems, Man, and Cybernetics, Hong Kong, China.10.1109/SMC.2015.485 ↗
7. Nordin, M., King, D., and Posthuma, S. (2018, January 10–12). But is it fun? Software testing in the video game industry, keynote speech. Proceedings of the 11th IEEE Conference on Software Testing, Validation and Verification (ICST 2018), Västerås, Sweden. Available online: http://www.es.mdh.se/icst2018/keynotes/#fun.
8. (2020, June 23). Blitz Games Studios, “Project Lifecycle.”. Available online: http://www.blitzgamesstudios.com/blitz_academy/game_dev/project_lifecycle.
9. Deep convolution neural network for accurate diagnosis of glaucoma using digital fundus images10.1016/j.ins.2018.01.051 ↗
10. Kingma, D.P., and Ba, J.L. (2015, January 23). ADAM: A method for stochastic optimization. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA.
11. (2020, June 23). Arcade History, “Pacman”. Available online: https://www.arcade-history.com/?page=detail&id=1914.
12. Tan, P.-N., Steinbach, M., and Kumar, V. (2005). Introduction to Data Mining, Addison-Wesley. Chapter 8.
13. Application of serious game model on simulation training for decision makings of project management