MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modeling · HackerPapers discussions

MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modeling — mentioned by abdljasser2

Sat, 26 Feb 2022 00:02:43 GMT

Copy pasting my a reply to a similar question Short answer is yes! Previous work has shown that we can obtain very good results from controlling DDSP models from midi input. The solutions I am familiar with employ a two stage approach where the first stage takes midi and turns it into control signals (pitch & loudness contours etc..) and the second stage turns the controls signals into audio (like the particular model I discuss in the blog post)[1][2][3]. I actually think that the first stage could also benefit from the transfer learning techniques we discuss in the blogpost. In terms of…

Paper and discussion history. A mention is not an endorsement.

MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modeling — mentioned by abdljasser2

Sat, 26 Feb 2022 00:01:41 GMT

Short answer is yes! Previous work has shown that we can obtain very good results from controlling DDSP models from midi input. The solutions I am familiar with employ a two stage approach where the first stage takes midi and turns it into control signals (pitch & loudness contours etc..) and the second stage turns the controls signals into audio (like the particular model I discuss in the blog post)[1][2][3]. I actually think that the first stage could also benefit from the transfer learning techniques we discuss in the blogpost. In terms of actually releasing a MIDI playable VST plugin I…

Paper and discussion history. A mention is not an endorsement.