Psychometric Mapping of Audio Features to Perceived Physical Characteristics of Virtual Objects
Colombo, Mattia and Dolhasz, Alan and Hockman, Jason and Harvey, Carlo (2021) Psychometric Mapping of Audio Features to Perceived Physical Characteristics of Virtual Objects. In: IEEE Conference on Games 2021, 17-20 Aug 2021, IT University Of Copenhagen (Virtual).
|
Text
Colombo_Psychometric_Preprint.pdf - Accepted Version Download (2MB) |
Abstract
Physically-based sound synthesis can simulate virtual sound sources whose audio features reflect the physical characteristics of corresponding objects displayed in a virtual environment, allowing for real-time generation of content without relying on pre-existing audio samples. This, however, requires efficient control strategies for sound synthesis models that, depending on the nature of the sounding objects, require to be mapped to varying physical characteristics displayed through visual information. In this experiment, participants were asked to adjust a set of sound synthesis parameters based on varying physical characteristics of a virtual bouncing ball: distance, elasticity and radius. Statistical analysis of recorded subject responses shows that object radius influences evaluation of pitch and amplitude for the object's representation. Similarly, distance influences user evaluation of both reverb and amplitude whilst elasticity doesn't influence user evaluation of the feature distributions. This result is consistent across user groups evaluated: audio experts and na\"ive listeners. Models are produced that encode these observations using linear regression, enabling automatic parameterisation of this feature space for audio synthesis engines.
| Item Type: | Conference or Workshop Item (Paper) | ||||||
|---|---|---|---|---|---|---|---|
| Dates: |
|
||||||
| Subjects: | CAH09 - mathematical sciences > CAH09-01 - mathematical sciences > CAH09-01-03 - statistics CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science CAH11 - computing > CAH11-01 - computing > CAH11-01-04 - software engineering CAH10 - engineering and technology > CAH10-01 - engineering > CAH10-01-10 - others in engineering |
||||||
| Divisions: | Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology | ||||||
| Depositing User: | Mattia Colombo | ||||||
| Date Deposited: | 09 Aug 2021 16:42 | ||||||
| Last Modified: | 22 Mar 2023 12:00 | ||||||
| URI: | https://www.open-access.bcu.ac.uk/id/eprint/11986 |
Actions (login required)
 |
View Item |
Tools
Tools