Acoustic Rendering Based on Geometry Reduction and Acoustic Material Classification
Colombo, Mattia and Dolhasz, Alan and Hockman, Jason and Harvey, Carlo (2022) Acoustic Rendering Based on Geometry Reduction and Acoustic Material Classification. In: IEEE Conference on Games (CoG) 2022, 21st - 24th August 2022, Beijing (Virtual). (In Press)
![]() |
Text
colombo_geometry_reduction_submission.pdf - Accepted Version Restricted to Repository staff only Available under License Creative Commons Attribution Share Alike. Download (17MB) | Request a copy |
Abstract
We present work in progress on a pipeline for audio rendering integrating vision-based systems for acoustic material classification. With a marching cubes algorithm, the pipeline estimates a cuboid acoustic volume encapsulating the listener, a sound source, and the surrounding environment. A variable-resolution binary field, samples and simplifies the input scene, and captures the appearance of surfaces to produce a set of image patches. A classifier infers acoustic materials, expressed as frequency-dependent acoustic absorption coefficients, from image patches. The estimated volume and aggregated acoustic materials provide input to the Image Source Model that models reverberation by generating Room Impulse Responses (RIRs). We conduct preliminary tests by applying our pipeline on a set of indoor and outdoor scenes, producing RIRs with inferred acoustic materials, comparing them against RIRs with manually assigned acoustic materials, extracting and evaluating objective metrics, such as reverberation or clarity. Through a learned metric on subjective responses, we compare perceptual aspects of automatically-generated RIRs against manually tagged. Objective and subjective analysis suggests that the pipeline can automate the acoustic material classification process by producing RIRs indistinguishable from manually-tagged counterparts.
Item Type: | Conference or Workshop Item (Paper) | ||||
---|---|---|---|---|---|
Dates: |
|
||||
Subjects: | CAH10 - engineering and technology > CAH10-01 - engineering > CAH10-01-01 - engineering (non-specific) CAH10 - engineering and technology > CAH10-03 - materials and technology > CAH10-03-07 - materials science CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science CAH11 - computing > CAH11-01 - computing > CAH11-01-05 - artificial intelligence CAH11 - computing > CAH11-01 - computing > CAH11-01-06 - computer games and animation CAH11 - computing > CAH11-01 - computing > CAH11-01-08 - others in computing |
||||
Divisions: | Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology > Digital Media Technology | ||||
Depositing User: | Mattia Colombo | ||||
Date Deposited: | 06 May 2022 15:13 | ||||
Last Modified: | 06 May 2022 15:13 | ||||
URI: | http://www.open-access.bcu.ac.uk/id/eprint/13207 |
Actions (login required)
![]() |
View Item |