PianoKontext: Expressive Performance Rendering from Deadpan Context
This paper introduces PianoKontext, a flow matching rendering model for classical piano music that generates variable-length performances.
This paper introduces a novel approach to generating variable-length performances in the latent space of a pretrained model.
Before reading this…
Applications
- →Music generation
- →Music editing
To understand this paper, make sure you know these concepts first:
- Music generationfind papers →
- Latent space representationfind papers →
Abstract
More Like ThisExpressive performance rendering (EPR) aims to generate realistic performances constrained on sequences of notes. However, flow matching audio editing models manipulate only synchronized music samples of the same duration, limiting their understanding of expressive timing. We introduce PianoKontext, a flow matching rendering model for classical piano music that generates variable-length performances in the latent space of a pretrained Music2Latent model. We synthesize MIDI scores into deadpan audio and employ Dynamic Time Warping (DTW) in the latent space to construct paired data for training. The aligned embeddings are concatenated in DiT blocks, allowing for a simple and effective learning of the dependencies between the score and performances. Audio samples are available at our demo page: https://realfolkcode.github.io/pianokontext_demo/.