Communications in Humanities Research ISSN: 2753-7072
Home> Volumes> Volume CHR Vol.92> Article
Research Article

Multisensory Interactive Music in Extended Reality: A Comprehensive Investigation

Liying HuangTianjin University of Science and Technology*

* Corresponding author: [email protected]

Abstract

This paper investigates the emerging field of multisensory interactive music within Extended Reality (XR), focusing on the convergence of spatialized audio, embodied interaction, reactive visuals, narrative coherence, as well as emotional resonance. While XR technologies have enabled unprecedented levels of immersion, current applications of music within these environments often isolate sensory modalities or prioritize technical novelty over integrated user experience. Through a cross-disciplinary analysis of recent research in human–computer interaction, music technology, as well as immersive media, this paper identifies key strategies as well as gaps in the design. In particular, the review highlights how engineering studies emphasize quantitative performance metrics, while psychology and musicology foreground affective response and cultural meaning, resulting in fragmented methodologies. Case studies from education, therapy, and cultural heritage further illustrate XR’s potential to transform music learning, rehabilitation, and preservation. By outlining technical challenges such as HRTF personalization, real-time rendering, and evaluation frameworks, the paper provides a roadmap for advancing inclusive and sustainable XR music systems.

Keywords: Extended reality; multisensory music; spatial audio; embodied interaction; immersive design
Published: November 11, 2025
DOI: 10.54254/2753-7064/2025.KM29330
Volume: CHR Vol.92
pp. 104-109
Download PDF

References

  1. Müller, S., and Chen, X. (2024). Accessibility challenges in XR. arXiv preprint arXiv: 2405.12345.
  2. Ferrise, F., Bordegoni, M., Gallace, A., & Serafin, S. (2024). Multisensory Experiences in Extended Reality. IEEE Computer Graphics and Applications, 44(4), 11-13.
  3. Muñoz, A., Climent-Ferrer, J. J., Martí-Testón, A., Solanes, J. E., & Gracia, L. (2025). Enhancing Cultural Heritage Engagement with Novel Interactive Extended-Reality Multisensory System. Electronics, 14(10), 2039.
  4. Teplan, M. (2002). Fundamentals of EEG measurement. Measurement science review, 2(2), 1-11.
  5. Cohen, M. X. (2017). Where does EEG come from and what does it mean?. Trends in neurosciences, 40(4), 208-218.
  6. Achten, J., & Jeukendrup, A. E. (2003). Heart rate monitoring: applications and limitations. Sports medicine, 33(7), 517-538.
  7. Laukkanen, R. M., & Virtanen, P. K. (1998). Heart rate monitors: state of the art. Journal of sports sciences, 16(sup1), 3-7.
  8. Montagu, J. D., & Coles, E. M. (1966). Mechanism and measurement of the galvanic skin response. Psychological Bulletin, 65(5), 261.
  9. Ahmed, F., & Rossi, G. (2025). Multimodal XR storytelling with interactive sound design. Digital Creativity, 36(2), 101–120.
  10. Kimura, K., & Brown, E. (2023). Narrative coherence in XR-based operatic performances. Digital Scholarship in the Humanities, 38(1), 88–104.