Psychometric Mapping of Audio Features to Perceived Physical Characteristics of Virtual Objects

Colombo, Mattia and Dolhasz, Alan and Hockman, Jason and Harvey, Carlo (2021) Psychometric Mapping of Audio Features to Perceived Physical Characteristics of Virtual Objects. In: IEEE Conference on Games 2021, 17-20 Aug 2021, IT University Of Copenhagen (Virtual).

Preview

Text Colombo_Psychometric_Preprint.pdf - Accepted Version Download (2MB)

Abstract

Physically-based sound synthesis can simulate virtual sound sources whose audio features reflect the physical characteristics of corresponding objects displayed in a virtual environment, allowing for real-time generation of content without relying on pre-existing audio samples. This, however, requires efficient control strategies for sound synthesis models that, depending on the nature of the sounding objects, require to be mapped to varying physical characteristics displayed through visual information. In this experiment, participants were asked to adjust a set of sound synthesis parameters based on varying physical characteristics of a virtual bouncing ball: distance, elasticity and radius. Statistical analysis of recorded subject responses shows that object radius influences evaluation of pitch and amplitude for the object's representation. Similarly, distance influences user evaluation of both reverb and amplitude whilst elasticity doesn't influence user evaluation of the feature distributions. This result is consistent across user groups evaluated: audio experts and na\"ive listeners. Models are produced that encode these observations using linear regression, enabling automatic parameterisation of this feature space for audio synthesis engines.

Item Type:	Conference or Workshop Item (Paper)
Dates:	Date Event 28 June 2021 Accepted 20 August 2021 Published Online
Subjects:	CAH09 - mathematical sciences > CAH09-01 - mathematical sciences > CAH09-01-03 - statistics CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science CAH11 - computing > CAH11-01 - computing > CAH11-01-04 - software engineering CAH10 - engineering and technology > CAH10-01 - engineering > CAH10-01-10 - others in engineering
Divisions:	Faculty of Computing, Engineering and the Built Environment > College of Computing
Depositing User:	Mattia Colombo
Date Deposited:	09 Aug 2021 16:42
Last Modified:	22 Mar 2023 12:00
URI:	https://www.open-access.bcu.ac.uk/id/eprint/11986

Actions (login required)

View Item