Audio-Based Gamified UI/UX Design for Blind Players
Abstract
Electronic games still rely heavily on visual interfaces, and information about game status, actions, and rewards is commonly conveyed through buttons, icons, colors, text, and animations, which creates accessibility barriers for blind and low-vision (BLV) players. Although feasible approaches such as audio cues, spatial audio, voice feedback, and haptic assistance already exist, related practices are often implemented separately and lack a systematic framework for integrated accessible game UI/UX design. This paper examines how audio-based gamified UI/UX design can support accessible, easy-to-operate, and immersive gaming experiences for BLV players. Combining literature review and case analysis, the paper analyzes accessible games, audio interaction, existing difficulties in game UI/UX, and psychological factors such as flow, motivation, and immersion. The study identifies key obstacles created by visual-by-default interfaces and reviews existing auditory and tactile approaches and provides suggestions for audio-based game UI/UX design, including information, interaction, positioning, motivation, and flow. The analysis suggests that audio-led and multimodal design can improve accessibility and support richer interaction but cannot fully eliminate limitations related to information bandwidth, cognitive load, individual differences, and hardware requirements. The paper concludes that accessible game design should consider audio-led or multimodal UI/UX design and incorporate psychological factors into accessibility research, while future research could explore empirical evaluation, AI-assisted audio, cross-platform consistency, and collaborative design with visually impaired players.
References
- Islam, M. N., Inan, T. T., Promi, N. T., Diya, S. Z., & Islam, A. K. (2024). Design, implementation, and evaluation of a mobile game for blind people: Toward making mobile fun accessible to everyone. InInformation and Communication Technologies for Humanitarian Services(pp. 251–270). Institution of Engineering and Technology.
- Guerreiro, J., Kim, Y., Nogueira, R., Rodrigues, A., & Gonçalves, D. (2023). The design space of the auditory representation of objects and their behaviours in virtual reality for blind people.IEEE Transactions on Visualization and Computer Graphics, 29(5), 2763–2773.
- Mason, Z., Green, D. P., Lindley, J., & Coulton, P. (2023). Improving digital accessibility through audio-game co-design. InProceedings of the 2023 Digital Games Research Association Conference (DiGRA '23). Digital Games Research Association.
- Agrimi, E., Battaglini, C., Bottari, D., Gnecco, G., & Leporini, B. (2024). Game accessibility for visually impaired people: A review.Soft Computing, 28(17–18), 10475–10489.
- Coronado, A., Carvalho, S., & Berretta, L. (2023). Game accessibility: Adaptation of a digital escape room game to improve spatial cognitive skills on blind people. InProceedings of the 22nd Brazilian Symposium on Human Factors in Computing Systems (IHC '23), 1–10.
- Larreina-Morales, M. E., & Mangiron, C. (2023). Audio description in video games? Persons with visual disabilities weigh in.Universal Access in the Information Society, 23(2), 577–588.
- Yu, H., & He, H. (2024). Gamified participatory design empowers blind people's emotional experience—Take "Sound·Sound" as an example. InDesign, User Experience, and Usability: 13th International Conference, DUXU 2024 (Lecture Notes in Computer Science, Vol. 14714)(pp. 165–174). Springer.
- Ramos Aguiar, L. R., Álvarez Rodríguez, F. J., Madero Aguilar, J. R., Navarro Plascencia, V., & Lazcano Ortiz, L. E. (2023). Implementing gamification for blind and autistic people with tangible interfaces, extended reality, and universal design for learning: Two case studies.Applied Sciences, 13(5), 3159.
- Piloti, J. S., Silva, R. P., & Silva, T. L. K. (2023). Development of accessible audiogames for blind people: A systematic literature review.Revista Educação Especial, 36, e68807.
- Raina, A. S., Mohanty, R. R., Bhuvanesh, A., et al. (2023). Pointing tasks using spatial audio on smartphones for people with vision impairments.Journal of Computing and Information Science in Engineering, 23(6), 060801.