Smartphone Drum: Gesture-based Digital Musical Instruments Application for Deaf and Hard of Hearing People

Sarcar, Sayan (2021) Smartphone Drum: Gesture-based Digital Musical Instruments Application for Deaf and Hard of Hearing People. In: SUI '21: Symposium on Spatial User Interaction, 9th - 10th November 2021, Online.

[img]
Preview
Text
2021_SUI_Posters_Smartphone_Drum_Sayan_Sarcar.pdf - Accepted Version

Download (611kB)

Abstract

Smartphone applications that allow users to enjoy playing musical instruments have emerged, opening up numerous related opportunities. However, it is difficult for deaf and hard of hearing (DHH) people to use these apps because of limited access to auditory information. When using real instruments, DHH people typically feel the music from the vibrations transmitted by the instruments or the movements of the body, which is not possible when playing with these apps. We introduce “smartphone drum,” a smartphone application that presents a drum-like vibrotactile sensation when the user makes a drumming motion in the air with their smartphone like a drumstick. We implemented an early prototype and received feedback from six DHH participants. We discuss the technical implementation and the future of new instruments of vibration.

Item Type: Conference or Workshop Item (Poster)
Identification Number: https://doi.org/10.1145/3485279.3488285
Dates:
DateEvent
21 September 2021Accepted
9 November 2021Published
Uncontrolled Keywords: Music, Game, User study, Deaf, Hard of hearing
Subjects: CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
Divisions: Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology > Digital Media Technology
Depositing User: Sayan Sarcar
Date Deposited: 22 Dec 2021 11:29
Last Modified: 22 Dec 2021 11:31
URI: http://www.open-access.bcu.ac.uk/id/eprint/12545

Actions (login required)

View Item View Item

Research

In this section...