Exploring Text Selection in Augmented Reality Systems

Liu, Xinyi and Meng, Xuanru and Becky, Spittle and Xu, Wenge and Gao, BoYu and Liang, Hai-Ning (2023) Exploring Text Selection in Augmented Reality Systems. In: The 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (ACM SIGGRAPH VRCAI 2022), 27th - 29th December 2022, Guangzhou, China.

BCU_AR_text_selection.pdf - Accepted Version

Download (794kB)


Text selection is a common and essential activity during text interaction in all interactive systems. As Augmented Reality (AR) head-mounted displays (HMDs) become more widespread, they will need to provide effective interaction techniques for text selection that ensure users can complete a range of text manipulation tasks (e.g., to highlight, copy, and paste text, send instant messages, and browse the web). As a relatively new platform, text selection in AR is largely unexplored and the suitability of interaction techniques supported by current AR HMDs for text selection tasks is unclear. This research aims to fill this gap and report on an experiment with 12 participants, which compares the performance and usability (user experience and workload) of four possible techniques (Hand+Pinch, Hand+Dwell, Head+Pinch, and Head+Dwell). Our results suggest that Head+Dwell should be the default selection technique, as it is relatively fast, has the lowest error rate and workload, and has the highest rated user experience and social acceptance.

Item Type: Conference or Workshop Item (Paper)
3 December 2022Accepted
13 January 2023Published Online
Uncontrolled Keywords: Text Selection, Augmented Reality, Pointing Methods, Selection Mechanisms, User Study
Subjects: CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
Divisions: Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology
Depositing User: Wenge Xu
Date Deposited: 14 Dec 2022 12:10
Last Modified: 22 Mar 2023 12:00
URI: https://www.open-access.bcu.ac.uk/id/eprint/13994

Actions (login required)

View Item View Item


In this section...