Originally Posted by Guitarhacker
While I have seen a lot of things brag about being able to take an audio file and convert it into midi, I have yet to actually get anything close to resembling a satisfactory result. I'd love to see something that could take the stems and convert into midi for use with a high quality sampler
I suspect the problem people will run into is getting the expression to work well. That means really good pitch tracking (for bends and such) as well as amplitude. Pitch tracking already exists, but not all MIDI instruments are consistent on their mapping of pitch bends.

MIDI instruments normally have sampled articulations (i.e. hammer ons, feedback, slides, pizzicato, etc.) that require having different articulations on different MIDI channels, so there's another layer of transformation that's probably going to have to be added manually.

At some point, it's likely that SUNO will offer MIDI to audio. This already exists for a number of products that automatically add in articulations. For some instruments, these articulations aren't even specified in the MIDI - the instrument automatically figures out what articulation is appropriate.

For this to happen with high quality, it means that SUNO would have to sample instruments in isolation, which I don't believe they've done. That doesn't mean they don't have any tricks up their sleeve. For example, Audacity has an OpenVINO "Super Resolution" option that will upscale audio and add detail. So perhaps something like that can be used to deal with quality loss with the step splitting process.

We'll see.

-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?