Psychometric Mapping of Audio Features to Perceived Physical Characteristics of Virtual Objects

Colombo, Mattia and Dolhasz, Alan and Hockman, Jason and Harvey, Carlo (2021) Psychometric Mapping of Audio Features to Perceived Physical Characteristics of Virtual Objects. In: IEEE Conference on Games 2021, 17-20 Aug 2021, IT University Of Copenhagen (Virtual).

Colombo_Psychometric_Preprint.pdf - Accepted Version

Download (2MB)


Physically-based sound synthesis can simulate virtual sound sources whose audio features reflect the physical characteristics of corresponding objects displayed in a virtual environment, allowing for real-time generation of content without relying on pre-existing audio samples. This, however, requires efficient control strategies for sound synthesis models that, depending on the nature of the sounding objects, require to be mapped to varying physical characteristics displayed through visual information. In this experiment, participants were asked to adjust a set of sound synthesis parameters based on varying physical characteristics of a virtual bouncing ball: distance, elasticity and radius. Statistical analysis of recorded subject responses shows that object radius influences evaluation of pitch and amplitude for the object's representation. Similarly, distance influences user evaluation of both reverb and amplitude whilst elasticity doesn't influence user evaluation of the feature distributions. This result is consistent across user groups evaluated: audio experts and na\"ive listeners. Models are produced that encode these observations using linear regression, enabling automatic parameterisation of this feature space for audio synthesis engines.

Item Type: Conference or Workshop Item (Paper)
Date: 20 August 2021
Subjects: G300 Statistics
G400 Computer Science
G600 Software Engineering
H900 Others in Engineering
Divisions: Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology > Digital Media Technology
Depositing User: Mattia Colombo
Date Deposited: 09 Aug 2021 16:42
Last Modified: 27 Aug 2021 13:20

Actions (login required)

View Item View Item


In this section...