An Exploration of Hands-free Text Selection for Virtual Reality Head-Mounted Displays

Meng, Xuanru and Xu, Wenge and Liang, Hai-Ning (2022) An Exploration of Hands-free Text Selection for Virtual Reality Head-Mounted Displays. In: IEEE International Symposium on Mixed and Augmented Reality, 17th Oct - 21st Oct 2022, Singapore.

ISMAR_22_HandsFreeTextSelection__BCU_Open_Access_.pdf - Accepted Version

Download (6MB)


Hand-based interaction, such as using a handheld controller or making hand gestures, has been widely adopted as the primary method for interacting with both virtual reality (VR) and augmented reality (AR) head-mounted displays (HMDs). In contrast, hands-free interaction avoids the need for users' hands and although it can afford additional benefits, there has been limited research in exploring and evaluating hands-free techniques for these HMDs. As VR HMDs become ubiquitous, people will need to do text editing, which requires selecting text segments. Similar to hands-free interaction, text selection is underexplored. This research focuses on both, text selection via hands-free interaction. Our exploration involves a user study with 24 participants to investigate the performance, user experience, and workload of three hands-free selection mechanisms (Dwell, Blink, Voice) to complement head-based pointing. Results indicate that Blink outperforms Dwell and Voice in completion time and accuracy. Users' subjective feedback also shows that Blink is the preferred technique for text selection. This work is the first to explore hands-free interaction for text selection in VR HMDs and our results provide a solid platform for further research in this important area.

Item Type: Conference or Workshop Item (Paper)
Identification Number:
13 August 2022Accepted
31 December 2022Published Online
Uncontrolled Keywords: Text Selection, Virtual Reality, User Study, Hands-free Interaction
Subjects: CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
Divisions: Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology
Depositing User: Wenge Xu
Date Deposited: 30 Aug 2022 13:15
Last Modified: 22 Mar 2023 12:00

Actions (login required)

View Item View Item


In this section...