Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Interest
Topics
Details

Details

  • Name

    Zijing Cao
  • Role

    Research Assistant
  • Since

    01st December 2023
Publications

2025

Exploring the Role of Sound Design in Serious Games: Impact on User Experience and Learning Outcomes

Authors
Cao, Z; Pinto, AS; Bernardes, G;

Publication
International Conference on Computer Supported Education, CSEDU - Proceedings

Abstract
Sound design plays an important role in serious games, influencing user experience and learning outcomes. However, deriving general principles and best practices remains challenging, as most literature relies on case-based studies in different application domains. Through a systematic review of the literature, 21 studies were analyzed to address two key questions: 1) what types of serious games and application domains incorporate sound design? and 2) what sound design strategies are implemented to enhance user experience and learning outcomes? The findings show that serious games have mainly focused on education, healthcare, and training, using sound to enhance motivation (50%), cognition (32%), and knowledge acquisition (18%). Furthermore, sound design strategies fulfill distinct roles: sound effects enhance feedback and engagement, background music influences motivation and cognitive processing, ambient sounds support navigation and emotional regulation, and dialogue facilitates knowledge acquisition. The findings highlight the need for further research to establish standardized sound design principles to optimize user experience and learning outcomes in serious games. Copyright © 2025 by SCITEPRESS - Science and Technology Publications, Lda.

2023

Sound Design Impacts User Experience and Attention in Serious Game

Authors
Cao, Z; Magalhães, E; Bernardes, G;

Publication
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Abstract
We study the impact of sound design – soundscape, sound effects, and auditory notifications, namely earcons – on the player’s experience of serious games. Three sound design versions for the game Venci’s Adventures have been developed: 1) no sound; 2) standard sound design, including soundscapes and sound effects; and 3) standard sound design with auditory notification (namely, earcons). Perceptual experiments were conducted to evaluate the most suitable attention retention earcons from a diverse collection of timbres, pitch, and melodic patterns, as well as the user experience of the different sound design versions assessed in pairs (1 vs. 2 and 2 vs. 3). Our results show that participants (n= 23 ) perceive better user experience in terms of game playing competence, immersion, flow, challenge and affect, and enhanced attention retention when adopting standard sound design with the earcons. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.