A Texture Superpixel Approach to Semantic Material Classification for Acoustic Geometry Tagging

Colombo, Mattia and Dolhasz, Alan and Harvey, Carlo (2021) A Texture Superpixel Approach to Semantic Material Classification for Acoustic Geometry Tagging. In: ACM CHI 2021, May 8-13, Online Virtual Conference (originally Yokohama, Japan).

Preview

Text chi21c-sub1895-i7.pdf - Accepted Version Download (1MB)

Abstract

The current state of audio rendering algorithms allows efficient sound propagation, reflecting realistic acoustic properties of real environments. Among factors affecting realism of acoustic simulations is the mapping between an environment’s geometry, and acoustic information of materials represented. We present a pipeline to infer material characteristics from their visual representations, providing an automated mapping. A trained image classifier estimates semantic material information from textured meshes mapping predicted labels to a database of measured frequency-dependent absorption coefficients; trained on a material image patches generated from superpixels, it produces inference from meshes, decomposing their unwrapped textures. The most frequent label from predicted texture patches determines the acoustic material assigned to the input mesh. We test the pipeline on a real environment, capturing a conference room and reconstructing its geometry from point cloud data. We estimate a Room Impulse Response (RIR) of the virtual environment, which we compare against a measured counterpart.

Item Type:	Conference or Workshop Item (Paper)
Identification Number:	10.1145/3411763.3451657
Dates:	Date Event 18 February 2021 Accepted 8 May 2021 Published Online
Subjects:	CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science CAH11 - computing > CAH11-01 - computing > CAH11-01-05 - artificial intelligence
Divisions:	Faculty of Computing, Engineering and the Built Environment > College of Computing
Depositing User:	Carlo Harvey
Date Deposited:	16 Mar 2021 10:36
Last Modified:	22 Mar 2023 12:00
URI:	https://www.open-access.bcu.ac.uk/id/eprint/11281

Actions (login required)

View Item