Smartphone Drum: Gesture-based Digital Musical Instruments Application for Deaf and Hard of Hearing People

Sarcar, Sayan (2021) Smartphone Drum: Gesture-based Digital Musical Instruments Application for Deaf and Hard of Hearing People. In: SUI '21: Symposium on Spatial User Interaction, 9th - 10th November 2021, Online.

Preview

Text 2021_SUI_Posters_Smartphone_Drum_Sayan_Sarcar.pdf - Accepted Version Download (611kB)

Abstract

Smartphone applications that allow users to enjoy playing musical instruments have emerged, opening up numerous related opportunities. However, it is difficult for deaf and hard of hearing (DHH) people to use these apps because of limited access to auditory information. When using real instruments, DHH people typically feel the music from the vibrations transmitted by the instruments or the movements of the body, which is not possible when playing with these apps. We introduce “smartphone drum,” a smartphone application that presents a drum-like vibrotactile sensation when the user makes a drumming motion in the air with their smartphone like a drumstick. We implemented an early prototype and received feedback from six DHH participants. We discuss the technical implementation and the future of new instruments of vibration.

Item Type:	Conference or Workshop Item (Poster)
Identification Number:	10.1145/3485279.3488285
Dates:	Date Event 21 September 2021 Accepted 9 November 2021 Published
Uncontrolled Keywords:	Music, Game, User study, Deaf, Hard of hearing
Subjects:	CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
Divisions:	Faculty of Computing, Engineering and the Built Environment > College of Computing
Depositing User:	Sayan Sarcar
Date Deposited:	22 Dec 2021 11:29
Last Modified:	22 Mar 2023 12:00
URI:	https://www.open-access.bcu.ac.uk/id/eprint/12545

Actions (login required)

View Item