Psychometric Mapping of Audio Features to Perceived Physical Characteristics of Virtual Objects

Colombo, Mattia and Dolhasz, Alan and Hockman, Jason and Harvey, Carlo (2021) Psychometric Mapping of Audio Features to Perceived Physical Characteristics of Virtual Objects. In: IEEE Conference on Games 2021, 17-20 Aug 2021, IT University Of Copenhagen (Virtual).

Colombo_Psychometric_Preprint.pdf - Accepted Version

Download (2MB)


Physically-based sound synthesis can simulate virtual sound sources whose audio features reflect the physical characteristics of corresponding objects displayed in a virtual environment, allowing for real-time generation of content without relying on pre-existing audio samples. This, however, requires efficient control strategies for sound synthesis models that, depending on the nature of the sounding objects, require to be mapped to varying physical characteristics displayed through visual information. In this experiment, participants were asked to adjust a set of sound synthesis parameters based on varying physical characteristics of a virtual bouncing ball: distance, elasticity and radius. Statistical analysis of recorded subject responses shows that object radius influences evaluation of pitch and amplitude for the object's representation. Similarly, distance influences user evaluation of both reverb and amplitude whilst elasticity doesn't influence user evaluation of the feature distributions. This result is consistent across user groups evaluated: audio experts and na\"ive listeners. Models are produced that encode these observations using linear regression, enabling automatic parameterisation of this feature space for audio synthesis engines.

Item Type: Conference or Workshop Item (Paper)
28 June 2021Accepted
20 August 2021Published Online
Subjects: CAH09 - mathematical sciences > CAH09-01 - mathematical sciences > CAH09-01-03 - statistics
CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
CAH11 - computing > CAH11-01 - computing > CAH11-01-04 - software engineering
CAH10 - engineering and technology > CAH10-01 - engineering > CAH10-01-10 - others in engineering
Divisions: Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology
Depositing User: Mattia Colombo
Date Deposited: 09 Aug 2021 16:42
Last Modified: 22 Mar 2023 12:00

Actions (login required)

View Item View Item


In this section...