Soundtrack Loudness as a Depth Cue in Stereoscopic 3D Media

Manolas, Christos, Pauletto, Sandra and Jang, Jon (2020) Soundtrack Loudness as a Depth Cue in Stereoscopic 3D Media. Convergence: The International Journal of Research into New Media Technologies. ISSN 1354-8565 (In Press)

Abstract

Assisted by the technological advances of the past decades, stereoscopic 3D cues are currently being integrated both in interactive and non-interactive media. Arguably, the main focus of this effort is placed on the creation of an increased sense of visual depth. Considering that human perception relies heavily on the audiovisual integration rather than on visual information alone, it is rather surprising that, in contrast to the evident interest towards the study of realistic 3D audio spatialisation techniques and technologies, relatively little attention has been given so far to the potential effect of the soundtrack on 3D depth perception in terms of the soundtrack. The multisensory nature of human perception suggests that the potential of sound design as a means to influence depth perception in the stereoscopic 3D visual world is worthy of further exploration. This study reports on our research into the possibilities of using alterations of the volume levels of the soundtrack as a means of affecting the perception of visual depth while viewing stereoscopic 3D animation clips. Based on previous findings indicating that the volume level of the soundtrack may be related to the perception of visual depth, a series of experiments further explored the effectiveness of this auditory cue. Results suggest that, under certain conditions, differences in volume levels of the soundtrack could influence the judgement of visual depth in a way that is opposite to real life expectations. It is suggested that different, more metaphorical perceptual mechanisms are in play when viewing stereoscopic 3D presentations than in real life. In this context, we conclude that stereoscopic 3D media can benefit from further exploration of the effectiveness of certain auditory cues as a means to enhance and support the perception of depth within the 3D environment.

This is the latest version of this item.

Available Versions of this Item

Actions (login required)

Edit Item Edit Item