Multimodal Gaze Interaction for Creative Design

Creed, Chris and Frutos-Pascual, Maite and Williams, Ian (2020) Multimodal Gaze Interaction for Creative Design. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, April 25 - 30, Honolulu, HI, USA.

chi20c-sub1768-cam-i38.pdf - Accepted Version

Download (1MB)


We present a new application (“Sakura”) that enables people with physical impairments to produce creative visual design work using a multimodal gaze approach. The system integrates multiple features tailored for gaze interaction including the selection of design artefacts via a novel grid approach, control methods for manipulating canvas objects, creative typography, a new color selection approach, and a customizable guide technique facilitating the alignment of design elements. A user evaluation (N=24) found that non-disabled users were able to utilize the application to complete common design activities and that they rated the system positively in terms of usability. A follow-up study with physically impaired participants (N=6) demonstrated they were able to control the system when working towards a website design, rating the application as having a good level of usability. Our research highlights new directions in making creative activities more accessible for people with physical impairments.

Item Type: Conference or Workshop Item (Paper)
Additional Information: Published with ISBN: 978-1450367080
16 January 2020Accepted
25 April 2020Published Online
Uncontrolled Keywords: Eye gaze tracking; gaze interaction; interface design; eye gaze design.
Subjects: CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
Divisions: Faculty of Computing, Engineering and the Built Environment
Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology
Depositing User: Chris Creed
Date Deposited: 02 Mar 2020 08:52
Last Modified: 22 Mar 2023 12:01

Actions (login required)

View Item View Item


In this section...