Events

Date: 30 July 2024   Time: 15:00 - 16:00

Location: G2, Engineering Building, E1 4NS Map 

You are invited to join us for a C4DM seminar on Tuesday 30th July from 3-4 pm, where Hyon Kim will be presenting his work on modeling the dynamic information of piano performance. Attend in person in ENG G2 or virtually via Zoom. Please see details below.

Topic: Score Informed Note-level MIDI Velocity Estimation and Its Transcription into Symbolics
Speaker: Hyon Kim
Date/time: 30 July 2024, 3-4 pm
Location: G2, Engineering Building
Zoom link: https://qmul-ac-uk.zoom.us/j/9798452959

Abstract:
It is a well known fact that the dynamics in piano performance gives significant effect in expressiveness. Taking the polyphonic nature of the instrument into account, analysing information to form dynamics for each performed note has significant meaning to understand piano performance in a quantitative way. It is also a key element in an education context for piano learners.
In this study, we developed a model for estimating MIDI velocity for each note, as one of indicators to represent loudness, with a condition of score by a Deep Neural Network (DNN) and Feature-wise Linear Modulation (FiLM) conditioning. Additionally, we have conducted research to map MIDI velocities to dynamics markings by combining performance MIDI roll and MusicXML information into one sequence.

Bio:
Hyon Kim is a PhD student at Music Technology Group, Universitat Pompeu Fabra under the supervision of Prof. Xavier Serra. Currently, Hyon is a Visiting Researcher at C4DM, QMUL, working under the supervision of Dr. Emmanouil Benetos. His research interests include modeling the dynamic information of piano performance and transcribing it into MIDI roll and symbolic representations using various DNN methods in a multimodal fashion, incorporating both score and audio data.