Content area
This paper investigates the role of sound and music in video games, focusing on their impact on players' emotions and behavior. By analyzing existing scientific literature, it identifies how sound design, including music and sound effects, shapes the gaming experience, spatial presence, and players' emotional and cognitive responses. A review of prior research examines the effects of multichannel sound, adaptive music, and audio habits across various video game genres, particularly in the context of horror games, fast-paced games, and educational simulations. Studies show that sound not only influences player engagement and enjoyment but also affects decisions and performance, with emphasis on increasing emotional tension, reducing stress, and enhancing immersion. Moreover, the paper discusses methodological challenges in measuring the impact of sound, as well as limitations in previous studies, which have often overlooked individual audio preferences and genre variations. The scientific contribution of this paper lies in connecting theoretical and empirical findings, providing guidance for future research in the field of sound design in video games.
ABSTRACT
This paper investigates the role of sound and music in video games, focusing on their impact on players' emotions and behavior. By analyzing existing scientific literature, it identifies how sound design, including music and sound effects, shapes the gaming experience, spatial presence, and players' emotional and cognitive responses. A review of prior research examines the effects of multichannel sound, adaptive music, and audio habits across various video game genres, particularly in the context of horror games, fast-paced games, and educational simulations. Studies show that sound not only influences player engagement and enjoyment but also affects decisions and performance, with emphasis on increasing emotional tension, reducing stress, and enhancing immersion. Moreover, the paper discusses methodological challenges in measuring the impact of sound, as well as limitations in previous studies, which have often overlooked individual audio preferences and genre variations. The scientific contribution of this paper lies in connecting theoretical and empirical findings, providing guidance for future research in the field of sound design in video games.
Keywords: player experience, adaptive music, audio design, emotional engagement, multichannel audio
1. INTRODUCTION
Sound design in video games, including music and sound effects, is critical in shaping the players experience. From the early days of video games, when soundtracks were simple and constrained by technical limitations, to todays advanced multichannel audio systems, music and sound play a vital role in creating an engaging and emotionally intense environment. [1] Players not only experience games visually but also rely heavily on auditory elements to understand the environment, create atmosphere, and elicit emotional reactions. As video game technology progresses, so too does the potential for sound design. [2] Today, players expect a dynamic sound experience that not only responds to their actions but also actively shapes their emotions, spatial perception, and in-game behavior. [3] In genres such as horror, where sound plays a decisive role in creating tension and fear, and in strategy games, where audio cues provide crucial information about the environment and dangers, sound is an indispensable tool for achieving an immersive experience. While many aspects of sound design have been explored, there remains space to better understand how sound influences emotional and cognitive responses, and how it can be optimized for different game types and player preferences. This paper aims to explore these aspects, with a focus on sound design in the context of horror games, fast-paced games, and educational simulations, and to provide guidelines for future research in this area.
2. PREVIOUS RESEARCH
Sound design in video games has long been shaped by technological constraints, but with the advancement of the industry, research has demonstrated that sound, particularly music and sound effects, significantly impacts players emotional and cognitive perceptions. One of the earliest studies in this area focused on the basic functions of sound in video games, such as marking actions and generating emotional responses in players. According to [4], sound design can play a key role in enhancing the atmosphere of a game and helping players immerse themselves more deeply, as confirmed by many studies linking sound effects to emotional responses such as fear, excitement, or stress. [4] Interest in sound components in video games grew with the rise of horror games, where sound effects became a crucial component in creating an atmosphere of tension and fear. [5] A study by Wöhrman and Ningalei [6] explored how sound design in horror games such as Dead Space and Left 4 Dead 2 could alter players' emotional reactions. The results showed that the presence of sound led to increased tension and greater player engagement compared to playing without sound. [6] Similar studies, such as those investigating the effects of adaptive music in Galactic Escape, also confirm that changes in music can amplify emotional tension and enhance gameplay enjoyment, contributing significantly to the understanding of the relationship between music and players' affective responses. [7] Early research also examined the effects of multichannel sound on the players experience. Rees-Jones and Murphy [8] highlighted that multichannel sound allows for better spatial localization of sound sources, giving players an advantage in tactical thinking, especially in games where action occurs off-screen or outside the visual field. [8, 9] These studies support the idea that spatial sound systems, such as Dolby Surround or 3D audio, allow players to better orient themselves in space and enhance their engagement in the game. While earlier studies provided significant insights into the role of sound in video games, many areas remain unexplored, particularly with regard to individual player preferences for audio experiences and the potential of adaptive music that changes according to player behavior and game context. Also there are some recent studies that have continued to explore the multifaceted impact of audio design in video games, particularly focusing on its emotional, cognitive, and behavioral effects on players. The study by Kozlov, P., Akram, A., & Shamoi, P. (2023) [10] introduces a fuzzy logic-based framework for recognizing emotions in children during gameplay by analyzing audio and video data. The research emphasizes the importance of understanding emotional responses to enhance user experience and suggests that integrating such recognition systems can lead to more emotionally adaptive gaming environments. The research from Makantasis, K., Liapis, A., & Yannakakis, G.N. (2023) [11] investigates the potential of deep learning models to predict player arousal levels using only audiovisual data from gameplay footage. The findings indicate that general-purpose representations can effectively capture emotional states, which has significant implications for designing responsive and immersive gaming experiences. Hutchings, P., & McCormack, J. (2023). [12] The authors propose a novel adaptive music system that integrates cognitive models of emotion with multi-agent composition techniques. Implemented in two distinct games, the system demonstrated enhanced player immersion and emotional engagement, underscoring the potential of adaptive music to dynamically align with gameplay contexts. Comprehensive review from Guillen, J., et al. (2023). [13] examines 47 studies on game sound design, focusing on its impact on immersion and accessibility. The findings highlight that while audio technology enhances immersion, there is a need for more research on its role in inclusivity and accessibility within gaming environments. Williams, D. (2023) in [14] explores the psychological relationship between players and video game sound, emphasizing how audio influences cognition and perception. It discusses the integration of various systems and the importance of function and task in game design, providing insights into how sound affects player experience.
These recent studies contribute to a deeper understanding of how audio design influences player experience, offering valuable insights for both researchers and game developers aiming to create more engaging and emotionally resonant games. Given the variety of game genres and mechanics, it is important to consider how sound impacts various aspects of the experience, from spatial presence to players' emotional reactions.
3. METHODOLOGY
The aim of this research was to analyze how sound in video games, including music and sound effects, affects players' emotional and cognitive responses. The analysis took into account different approaches to sound design, such as multichannel sound, adaptive music, and background sound effects, with a focus on their role across various video game genres. For the analysis, data from several key studies were utilized, which employed different methodological approaches. The primary method was experimental research, involving controlled gameplay conditions where participants responded to variants of sound design, with results measured using physiological and subjective measures. For example, the study by Wöhrman and Ningalei [6] used gameplay tests at three intervals-before, during, and after a session-to collect data on participants' emotional responses to sound effects in horror games, using heart rate monitors and eye-tracking devices. [6] Additionally, questionnaires and interviews were used to gather subjective data on how players perceive the sound components of the game and how they influence their behavior and emotional state during gameplay. For instance, a study on players' audio habits and motivations, conducted on a sample of 737 participants, revealed that players often ignore background music in favor of other sound effects or personal playlists, suggesting the need for more personalized sound design based on user preferences. [15] Another important methodological approach was quantitative examination of the impact of multichannel sound on players spatial perception and game performance. The study by Rees-Jones and Murphy [8] used stereo and surround sound rendering systems to analyze how different audio systems influenced players' ability to locate sound sources and react to in-game dangers. [8] By using these systems, the authors tracked reaction times and accuracy in sound localization. These studies provided the foundation for analyzing and synthesizing existing data. The methodology aimed to understand how sound design enhances players' emotional connection to the game and increases engagement, as well as to explore how different forms of sound can affect performance and decision-making.
4. RESEARCH STUDIES
Studies on sound in video games provide critical insights into how sound design shapes the player's experience. Whether in music, sound effects, or multichannel sound, audio has a significant impact on players' emotions, behavior, and performance. Different game genres, from horror to action games and simulations, utilize sound design in specific ways to enhance player engagement and emotional experience. One of the most notable studies is [6], which examines the effects of sound in horror games. In their study of Dead Space and Left 4 Dead 2, they investigated how sound effects, such as warning sounds for impending danger, can significantly increase emotional tension and the sense of fear in the game. The results showed that sound plays a crucial role in increasing player engagement, reducing uncertainty, and improving the overall gameplay experience. [6] This study supports the hypothesis that sound, particularly in genres such as horror, can increase emotional tension and enhance player enjoyment. Similarly, the study by Klimmt et al. [16] examined the effects of music on players' cognitive and emotional reactions in action video games. The research demonstrated that music can significantly increase gameplay enjoyment and affect players' emotional responses, such as increasing excitement during action moments or reducing stress during moments of relaxation.
The use of music in games like Assassins Creed: Black Flag helps players feel more present in the game, making on-screen action emotionally more significant. [16] In addition to emotional responses, multichannel sound plays a key role in spatial perception and player performance. Rees-Jones and Murphy [8] explored the impact of spatial sound in video games, particularly how multichannel systems like Dolby Surround and 3D sound improve players' ability to locate sound sources and react to threats. The results showed that multichannel sound, compared to stereo sound, allowed players to more quickly identify sound sources and improve overall performance in the game, highlighting how spatial sound can enhance tactical decisionmaking. [8] In Rogers, Jörg and Webers [17] study on players' audio habits and motivations, it was shown that many players ignore background music in favor of other sound effects or personal playlists. The study also revealed that players prefer more control over game audio, such as the option to turn off music while retaining sound effects. This research emphasizes the importance of understanding players' varying audio habits and preferences, which could shape future sound design in video games, focusing on flexibility and personalization of the audio experience. [17] Finally, the research by Plut and Pasquier [7] on adaptive music in video games shows that adjusting music based on game tension can significantly impact players' emotional reactions. The study showed that players in Galactic Escape felt more comfortable and tense when the music adapted to the intensity of the game, improving their experience of tension and engagement. These studies support the idea that music in video games should notremain static but should respond dynamically to the game environment. [7]
5. DISCUSSION AND LIMITATIONS
The studies reviewed in this paper underscore the pivotal role of sound in enhancing player engagement and shaping emotional responses across a range of video game genres. From horror games to action-packed titles and educational simulations, sound serves as a key tool for influencing player behavior, providing emotional cues, and enhancing the overall gameplay experience. The research demonstrates that multichannel sound, adaptive music, and strategically placed sound effects significantly impact players' emotional states, performance, and decision-making. However, there are notable limitations in the existing literature. First, while many studies focus on the physiological and emotional effects of sound, there is a lack of research that directly examines the relationship between sound and long-term player engagement. Many studies measure short-term emotional reactions or performance improvements, but less attention has been paid to how these factors contribute to sustained interest and motivation across multiple gaming sessions. Future research could explore how sound design influences long-term player retention and engagement, especially in games with complex narratives or open-world gameplay. Another limitation of current research is the homogeneity of study participants. Many studies rely on college-aged male participants, which raises concerns about the generalizability of findings to broader, more diverse player populations. Players' cultural backgrounds, individual preferences, and prior gaming experiences can significantly influence how they respond to sound in games, but these variables are often overlooked. Future studies should aim to include a more diverse participant pool to better understand the full spectrum of player responses to sound and music. Moreover, while studies such as those by [6] and [8] examine the impact of sound on player performance, they often neglect the role of user-specific factors such as individual preferences for sound styles or audio settings. The assumption that all players experience sound in the same way could limit the applicability of these findings. As audio customization tools and personalization options become more common in video games, it will be critical to study how these factors influence players' emotional and cognitive responses, as well as their gameplay performance.
Lastly, while the importance of adaptive music is emphasized, there is a lack of comprehensive research on the technical and creative challenges involved in its implementation. Music that dynamically shifts in response to player actions or environmental changes must be carefully designed and tested to ensure it enhances the experience without becoming intrusive or repetitive. However, notable limitations persist in the breadth and depth of current research. For instance, [10] demonstrate the applicability of emotion recognition systems, utilizing fuzzy logic to enhance interactive environments for younger audiences. This aligns with the broader understanding of sound as a driver of engagement but highlights the need for further exploration into age-specific emotional responses. Similarly, [11] provide evidence that deep learning models can predict arousal levels based on audiovisual gameplay data. While this offers exciting prospects for integrating emotion-driven soundscapes, it underscores a gap in practical implementation within real-time game environments. Hutchings and McCormack (2019) [12] argue for adaptive music systems that dynamically align with player behavior. Their findings highlight the role of adaptive sound in heightening immersion and emotional resonance. Yet, this innovation also introduces technical and creative challenges that remain insufficiently addressed in the literature. The emphasis on inclusivity and accessibility by Guillen et al. [13] reveals another dimension of sound design, one often overlooked in traditional studies. Their work underscores the necessity of addressing diverse player demographics and preferences, an area where current research and practice fall short. Similarly, Williams (2023) [14] elaborates on the cognitive and behavioral dimensions of sound, emphasizing its integration within complex game narratives. This perspective reinforces the need to move beyond the conventional focus on immediate emotional impacts to explore long-term effects on engagement and player retention. Future research should explore how different adaptive music systems are implemented and evaluate their effectiveness in improving emotional engagement across different game genres.
6. CONCLUSION
Sound design in video games is an integral aspect of player experience, influencing emotions, behaviors, and performance. This paper has reviewed the existing literature on the role of sound in gaming, highlighting the ways in which music, sound effects, and multichannel sound systems contribute to the immersive and interactive nature of video games. From the emotional tension in horror games to the enhanced spatial awareness in action games, sound is a key factor that shapes how players engage with games and how they feel during gameplay. While the research reviewed offers valuable insights, there are several avenues for future exploration. A deeper understanding of how sound design influences long-term engagement, the role of user-specific preferences, and the technical challenges of implementing adaptive music in video games can provide new directions for both academic research and practical game development. By addressing these gaps, future studies can help to further refine sound design practices and improve the overall player experience. Ultimately, the relationship between sound and gameplay is a multifaceted and dynamic one, deserving of continued scholarly attention as the industry moves toward increasingly sophisticated and immersive gaming experiences. Future research should not only build on existing findings but also consider the evolving preferences of diverse player demographics and the rapid technological advancements shaping the soundscapes of video games. As this paper illustrates, recent studies continue to highlight the transformative potential of audio elements, yet significant gaps persist that warrant further exploration. The incorporation of emotion recognition systems, as demonstrated by Kozlov, offers a promising avenue for tailoring soundscapes to diverse player needs. However, integrating such systems into live gaming environments requires addressing technical limitations. Similarly, the predictive models by Makantasis open opportunities for dynamic and adaptive soundscapes but necessitate real-time implementation frameworks.
Adaptive music, as emphasized by Hutchings and McCormack, holds particular promise for enhancing immersion. Nonetheless, challenges in its seamless integration underline the need for more sophisticated tools and frameworks. Furthermore, the insights from Guillen on accessibility and inclusivity call for a shift toward more player-centered design practices, particularly for underserved demographics. Finally, Williams provides a compelling argument for exploring long-term impacts of sound design on engagement and narrative immersion. As multichannel systems gain traction, their role in elevating both tactical and emotional gameplay experiences become increasingly evident, as highlighted by Rees-Jones and Murphy. Future research must expand its focus to include diverse player populations, address adaptive audio challenges, and consider the evolving demands of immersive technologies. By bridging these gaps, the field of sound design can achieve a more comprehensive understanding of its impact, paving the way for innovations that enhance not only gameplay but also the broader cultural relevance of video games.
LITERATURE
1. McDonald, G., 2005. A history of video game music. Retrieved December, 10, p.2016.
2. Đenović, I., 2018. Utjecaj stilskih odrednica video igara na percepciju korisnika.
3. Hatlak, D., Bernik, A. and Tomičić, I., 2023. Influence of Video Games on Cognitive Abilities and Intelligence. Tehnički glasnik, 17(4), pp.572-580.
4. Coleman, J., 2024. The use of sound in videogames, Retrieved 27.09.2024 from: https://jahmelcoleman.wordpress.com/games-development/the-use-of-sound-in-videogames/
5. Andersen, F., King, C.L. and Gunawan, A.A., 2021. Audio influence on game atmosphere during various game events. Procedia Computer Science, 179, pp.222-231.
6. Wöhrman, S. and Ningalei, N., 2018. The Impact of Sound on Player Experience-A literature study on how players experience the encounter with sound in horror-games.
7. Plut, C. and Pasquier, P., 2019, August. Music Matters: An empirical study on the effects of adaptive music on experienced and perceived player affect. In 2019 ieee conference on games (cog) (pp. 1-8). IEEE.
8. Rees-Jones, J. and Murphy, D.T., 2018. The impact of multichannel game audio on the quality and enjoyment of player experience. Emotion in video game soundtracking, pp.143-163.
9. Kenwright, B., 2020. There's more to sound than meets the ear: Sound in interactive environments. IEEE Computer Graphics and Applications, 40(4), pp.62-70.
10. Kozlov, P., Akram, A. and Shamoi, P., 2024. Fuzzy approach for audio-video emotion recognition in computer games for children. Procedia Computer Science, 231, pp.771-778.
11. Makantasis, K., Liapis, A. and Yannakakis, G.N., 2021. The pixels and sounds of emotion: Generalpurpose representations of arousal in games. IEEE Transactions on Affective Computing, 14(1), pp.680-693.
12. Hutchings, P.E. and McCormack, J., 2019. Adaptive music composition for games. IEEE Transactions on Games, 12(3), pp.270-280.
13. Guillen, G., Jylhä, H. and Hassan, L., 2021, June. The role sound plays in games: a thematic literature study on immersion, inclusivity and accessibility in game sound research. In Proceedings of the 24th International Academic Mindtrek Conference (pp. 12-20).
14. Williams, D.A.H., 2021. Psychophysiological approaches to sound and music in games. Cambridge University Press (CUP).
15. Rogers, K. and Weber, M., 2019, September. Audio habits and motivations in video game players. In Proceedings of the 14th International Audio Mostly Conference: A Journey in Sound (pp. 4552).
16. Klimmt, C., Possler, D., May, N., Auge, H., Wanjek, L. and Wolf, A.L., 2019. Effects of soundtrack music on the video game experience. Media Psychology, 22(5), pp.689-713.
17. Rogers, K., Jörg, M. and Weber, M., 2019, October. Effects of background music on risk-taking and general player experience. In Proceedings of the annual symposium on computer-human interaction in play (pp. 213-224).
Copyright Varazdin Development and Entrepreneurship Agency (VADEA) 2025