Multi-Modal Perception for Selective Rendering

Harvey, Carlo and Debattista, Kurt and Bashford-Rogers, Thomas and Chalmers, Alan (2017) Multi-Modal Perception for Selective Rendering. Computer Graphics Forum, 36 (1). pp. 172-183. ISSN 0167-7055

[img] Text
Multi-Modal Perception for Selective Rendering.pdf - Accepted Version
Restricted to Repository staff only until 25 January 2018.

Download (39MB) | Request a copy

Abstract

A major challenge in generating high-fidelity virtual environments (VEs) is to be able to provide realism at interactive rates. The high-fidelity simulation of light and sound is still unachievable in real time as such physical accuracy is very computationally demanding. Only recently has visual perception been used in high-fidelity rendering to improve performance by a series of novel exploitations; to render parts of the scene that are not currently being attended to by the viewer at a much lower quality without the difference being perceived. This paper investigates the effect spatialized directional sound has on the visual attention of a user towards rendered images. These perceptual artefacts are utilized in selective rendering pipelines via the use of multi-modal maps. The multi-modal maps are tested through psychophysical experiments to examine their applicability to selective rendering algorithms, with a series of fixed cost rendering functions, and are found to perform significantly better than only using image saliency maps that are naively applied to multi-modal VEs.

Item Type: Article
Additional Information: This is the peer reviewed version of the following article: Harvey, C., Debattista, K., Bashford-Rogers, T. and Chalmers, A. (2017), Multi-Modal Perception for Selective Rendering. Computer Graphics Forum, 36: 172–183. doi:10.1111/cgf.12793 which has been published in final form at https://doi.org/10.1111/cgf.12793 This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving.
Subjects: G400 Computer Science
Divisions: Faculty of Computing, Engineering and the Built Environment
Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology
Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology > Cyber Security
UoA Collections > UoA11: Computer Science and Informatics
Depositing User: $ Ian McDonald
Date Deposited: 16 Oct 2017 12:41
Last Modified: 19 Oct 2017 06:51
URI: http://www.open-access.bcu.ac.uk/id/eprint/5231

Actions (login required)

View Item View Item

Research

In this section...