Audio-Visual-Olfactory Resource Allocation for Tri-modal Virtual Environments

Doukakis, E. and Debattista, K. and Bashford-Rogers, T. and Dhokia, A. and Asadipour, A. and Chalmers, A. and Harvey, Carlo (2019) Audio-Visual-Olfactory Resource Allocation for Tri-modal Virtual Environments. IEEE Transactions on Visualization and Computer Graphics, 25 (5). pp. 1865-1875. ISSN 1077-2626

Preview

Text AVORAfTMVEs.pdf - Accepted Version Download (22MB)

Abstract

Virtual Environments (VEs) provide the opportunity to simulate a wide range of applications, from training to entertainment, in a safe and controlled manner. For applications which require realistic representations of real world environments, the VEs need to provide multiple, physically accurate sensory stimuli. However, simulating all the senses that comprise the human sensory system (HSS) is a task that requires significant computational resources. Since it is intractable to deliver all senses at the highest quality, we propose a resource distribution scheme in order to achieve an optimal perceptual experience within the given computational budgets. This paper investigates resource balancing for multi-modal scenarios composed of aural, visual and olfactory stimuli. Three experimental studies were conducted. The first experiment identified perceptual boundaries for olfactory computation. In the second experiment, participants ( N=25 ) were asked, across a fixed number of budgets ( M=5 ), to identify what they perceived to be the best visual, acoustic and olfactory stimulus quality for a given computational budget. Results demonstrate that participants tend to prioritize visual quality compared to other sensory stimuli. However, as the budget size is increased, users prefer a balanced distribution of resources with an increased preference for having smell impulses in the VE. Based on the collected data, a quality prediction model is proposed and its accuracy is validated against previously unused budgets and an untested scenario in a third and final experiment.

Item Type:	Article
Additional Information:	© 2019 IEEE.  Personal use of this material is permitted.  Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.”
Identification Number:	DOI: 10.1109/TVCG.2019.2898823
Dates:	Date Event 17 February 2019 Published 7 February 2019 Accepted
Uncontrolled Keywords:	Olfactory;Visualization;Computational modeling;Resource management;Mathematical model;Auditory system;Virtual environments;Multi-Modal;Cross-Modal;Tri-Modal;Sound;Graphics;Olfactory
Subjects:	CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
Divisions:	Faculty of Computing, Engineering and the Built Environment Faculty of Computing, Engineering and the Built Environment > College of Computing
Depositing User:	Carlo Harvey
Date Deposited:	29 Aug 2019 11:49
Last Modified:	12 Jan 2022 12:53
URI:	https://www.open-access.bcu.ac.uk/id/eprint/7909

Actions (login required)

View Item