Reach, a keyboard-based gesture recognition system for live piano sound modulation

Granieri, Niccolo and Dooley, James (2019) Reach, a keyboard-based gesture recognition system for live piano sound modulation. In: International Conference on New Interfaces for Musical Expressions 2019, 3-6 June 2019, Porto Alegre, Brazil.


Download (1MB)


This paper presents Reach, a keyboard-based gesture recog- nition system for live piano sound modulation. Reach is a system built using the Leap Motion Orion SDK, Pure Data and a custom C++ OSC mapper1. It provides control over the sound modulation of an acoustic piano using the pi- anist’s ancillary gestures.

The system was developed using an iterative design pro- cess, incorporating research findings from two user studies and several case studies. The results that emerged show the potential of recognising and utilising the pianist’s existing technique when designing keyboard-based DMIs, reducing the requirement to learn additional techniques.

Item Type: Conference or Workshop Item (Poster)
3 June 2019Published
20 March 2019Accepted
Subjects: CAH25 - design, and creative and performing arts > CAH25-02 - performing arts > CAH25-02-02 - music
Divisions: Faculty of Arts, Design and Media > Royal Birmingham Conservatoire
Depositing User: James Dooley
Date Deposited: 21 Jun 2019 11:38
Last Modified: 12 Jan 2022 16:54

Actions (login required)

View Item View Item


In this section...