Smartwatch-Based Audio–Gestural Insights in Violin Bow Stroke Analyses

Wilson, William and Granieri, Niccolò and Smith, Samuel and Harvey, Carlo and Ali-MacLachlan, Islah (2025) Smartwatch-Based Audio–Gestural Insights in Violin Bow Stroke Analyses. Transactions of the International Society for Music Information Retrieval, 8 (1). ISSN 2514-3298

Preview

Text 68b94fefa6b1a.pdf - Published Version Available under License Creative Commons Attribution. Download (3MB)

Abstract

Following the exposition of quantitative, identifiable idiosyncrasy in violin performance – via neural network classification – we demonstrate that smartwatch-based synchronous audio-gesture logging facilitates interpretable practice feedback in violin performance. The novelty of our approach is twofold: we exploit convenient multimodal data capture using a consumer smartwatch, recording wrist-movement and audio data in parallel. Further, we prioritise the delivery of performance insights at their most interpretable, quantifying tonal and temporal performance trends. Using such accessible hardware to observe meaningful, approachable performance insights, the feasibility of our approach is maximised for use in real-world teaching and learning environments. Presented analyses draw upon a primary dataset compiled from nine violinists executing defined performance exercises. Recordings segmented via note onset detection are subject to subsequent analyses. Trends identified include a cross-participant tendency to ‘rush’ up-bows versus down-bows, along with lesser temporal and tonal consistency when bowing Spiccato versus Legato.

Item Type:	Article
Identification Number:	10.5334/tismir.216
Dates:	Date Event 1 August 2025 Accepted 4 September 2025 Published Online
Uncontrolled Keywords:	datasets, neural networks, gestural analysis, computational musicology, violin, IMU sensors, technology-enhanced learning
Subjects:	CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science CAH25 - design, and creative and performing arts > CAH25-02 - performing arts > CAH25-02-02 - music
Divisions:	Architecture, Built Environment, Computing and Engineering > Computer Science
Depositing User:	Gemma Tonks
Date Deposited:	06 Oct 2025 13:25
Last Modified:	06 Oct 2025 13:25
URI:	https://www.open-access.bcu.ac.uk/id/eprint/16663

Actions (login required)

View Item