Converting Audio to MIDI - Open Source Project
By Jeff Stauffer
Hello, Recently I ran across an open source AI project for taking
audio files of solo piano recordings and converting them to a MIDI file
that can be played on a modern solenoid piano. The accuracy is quite
amazing, and captures the dynamics and pedaling of the performance:
https://github.com/bytedance/GiantMIDI-Piano
A friend and programmer from Japan helped me by taking their Python
code and making a small Windows executable to easily use this AI engine
to convert audio to MIDI. I have the executable available for free use
on my google drive along with an explanation on how to use it.
There is also a companion routine I asked my Japanese friend to make
that will shorten the ends of the MIDI notes. The reason for this is
that during the conversion process the AI engine does not seem to
detect the end of held notes that are pedaled. So this routine clips
the notes shorter so the solenoid piano can react and not hold the
keys down too long.
Here is a link to my Google drive if anyone cares to test drive an
AI converter:
https://drive.google.com/drive/folders/1OjBJBkm91M7uXVRtU-DkuqU-g15CyQOY?usp=share_link
There are a few sample MIDI files taken from YouTube and their original
audio from YouTube.
I would be interested in hearing feedback about this project and its
abilities and if this is interesting to others on the MMD.
Thanks,
Jeff Stauffer
[ Jeff,
[ I have dreamed of doing this since I owned a NeXT cube in the
[ late 80's. I'm sure there are others here that are interested too.
[ Thanks for sharing this inspiring work.
[ Jody
|
(Message sent Wed 10 May 2023, 15:06:15 GMT, from time zone GMT-0700.) |
|
|