PatRec: A Mobile Game for Learning Social Haptic Communication

Vuijk, Jessica G. J. and Gay, James and Plaisier, Myrthe A. and Kappers, Astrid M. L. and Theil, Arthur (2021) PatRec: A Mobile Game for Learning Social Haptic Communication. In: ASSETS 2021: The 23rd International ACM SIGACCESS Conference on Computers and Accessibility, October 18-22 2021, Virtual event.

[img] Text (PatRec: A Mobile Game for Learning Social Haptic Communication)
assets21_patrec_mobile_game_learning_social_haptic_communication.pdf - Accepted Version
Restricted to Registered users only

Download (1MB) | Request a copy


Social Haptic Communication (SHC) is one of the many tactile modes of communication used by persons with deafblindness to access information about their surroundings. SHC usually involves an interpreter executing finger and hand signs on the back of a person with multi-sensory disabilities. Learning SHC, however, can become challenging and time-consuming, particularly to those who experience deafblindness later in life. In this work, we present PatRec: a mobile game for learning SHC concepts. PatRec is a multiple-choice quiz game connected to a chair interface that contains a 3x3 array of vibration motors emulating different SHC signs. Players collect scores and badges whenever they guess the right SHC vibration pattern, leading to continuous engagement and a better position on a leaderboard. The game is also meant for family members to learn SHC. We report the technical implementation of PatRec and the findings from a user evaluation.

Item Type: Conference or Workshop Item (Paper)
Identification Number:
16 July 2021Accepted
18 October 2021Published Online
Uncontrolled Keywords: Deafblindness, Haptics, Game-Based Learning, Vibrotactile feedback, Visual Impairments, Assistive Technology, Tactile Sign Language, Accessible Games
Subjects: CAH11 - computing > CAH11-01 - computing > CAH11-01-06 - computer games and animation
Divisions: Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology
Depositing User: Arthur Theil
Date Deposited: 04 Oct 2021 13:43
Last Modified: 22 Mar 2023 12:00

Actions (login required)

View Item View Item


In this section...