Emotion-Aware Adaptive Design in Games: A Critical Review of Progress, Evaluation Bottlenecks, and Future Trends
Abstract
This paper reviews emotion-aware adaptive game design. It explains how games detecting player feelings can outperform traditional difficulty adjustment, which only tweaks numbers like health or damage. While such tweaks boost performance, they rarely reduce negative emotions or improve immersion. Affective computing now allows cameras and mics to spot frustration or boredom in real time. However, better detection does not always improve experience—a "last-mile" issue caused by overusing simple number tweaks, harming player control, and using weak testing. The review blends ideas from difficulty, immersion, emotion detection, audio, and story. It uses a three-part framework: how emotions are detected, what game elements are adapted, and how success is measured. Future games should adjust feedback, pacing, sound, and story while keeping players in control. Future paths include stable real-world emotion detection, modular engine tools, and long-term testing.
References
- Hunicke, R. (2005). The case for dynamic difficulty adjustment in games.ACE 2005. https://dl.acm.org/doi/10.1145/1067343.1067349
- Law, E. L.-C., et al. (2018). Validation of the game experience questionnaire (GEQ).CHI PLAY 2018. https://dl.acm.org/doi/10.1145/3270316.3270594
- Yli-Olli, V. (2020).Understanding player engagement: Flow theory in video game design. Bachelor's thesis, JAMK University. https://jyx.jyu.fi/handle/123456789/72345
- Brown, E., & Cairns, P. (2004). A grounded investigation of game immersion.CHI '04.
- Perttula, A., Kiili, K., Lindstedt, A., & Tuomi, P. (2017). Flow experience in game-based learning.International Journal of Serious Games, 4(1). https://www.sciencedirect.com/science/article/pii/S240589281730005X
- Auer, C., & Lankes, M. (2025). Personality-based narrative adaptation.FDG '25.
- Akbar, M. T., et al. (2019). Enhancing game experience with facial expression recognition.Procedia Computer Science, 157. https://www.sciencedirect.com/science/article/pii/S1877050919308530
- de la Fuente, C., et al. (2023). Multimodal recognition of frustration during gameplay.Multimedia Tools and Applications, 82. https://link.springer.com/article/10.1007/s11042-022-14347-8
- Nunes, C., & Darin, T. (2024). Echoes of player experience: Audio assessment in games.PACM HCI, 8(CHI PLAY). https://dl.acm.org/doi/10.1145/3678288
- Hudlicka, E. (2009). Affective game engines: Motivation and requirements.FDG '09. https://dl.acm.org/doi/10.5555/1746757.1746760
- Poels, K., et al. (2012). Player emotions and game preferences.Cyberpsychology, Behavior, and Social Networking, 15(1). https://www.liebertpub.com/doi/10.1089/cyber.2011.0162
- Kotsia, I., Zafeiriou, S., & Fotopoulos, S. (2013). Affective gaming: A comprehensive survey.IEEE CVPR Workshops, 663–670. https://ieeexplore.ieee.org/document/6611957
- Kalateh, S., et al. (2024). Multimodal emotion recognition: A systematic review.IEEE Access, 12. https://ieeexplore.ieee.org/document/10401913
- Hudlicka, E. (2008).Affective computing for game design. GAMEON-NA 2008. https://www.researchgate.net/publication/266345754_Affective_computing_for_game_design
- Hudlicka, E., & Broekens, J. (2009).Modeling emotions in game characters. ACII 2009. https://ieeexplore.ieee.org/document/5304132