Mechanical Music Digest  Archives
You Are Not Logged In Login/Get New Account
Please Log In. Accounts are free!
Logged In users are granted additional features including a more current version of the Archives and a simplified process for submitting articles.
Home Archives Calendar Gallery Store Links Info
MMD > Archives > May 2023 > 2023.05.09 > 01Prev  Next


Converting Audio to MIDI - Open Source Project
By Jeff Stauffer

Hello, Recently I ran across an open source AI project for taking
audio files of solo piano recordings and converting them to a MIDI file
that can be played on a modern solenoid piano. The accuracy is quite
amazing, and captures the dynamics and pedaling of the performance:

https://github.com/bytedance/GiantMIDI-Piano 

A friend and programmer from Japan helped me by taking their Python
code and making a small Windows executable to easily use this AI engine
to convert audio to MIDI. I have the executable available for free use
on my google drive along with an explanation on how to use it.

There is also a companion routine I asked my Japanese friend to make
that will shorten the ends of the MIDI notes. The reason for this is
that during the conversion process the AI engine does not seem to
detect the end of held notes that are pedaled. So this routine clips
the notes shorter so the solenoid piano can react and not hold the
keys down too long.

Here is a link to my Google drive if anyone cares to test drive an
AI converter:

https://drive.google.com/drive/folders/1OjBJBkm91M7uXVRtU-DkuqU-g15CyQOY?usp=share_link 
There are a few sample MIDI files taken from YouTube and their original
audio from YouTube.

I would be interested in hearing feedback about this project and its
abilities and if this is interesting to others on the MMD.

Thanks,

Jeff Stauffer

[ Jeff,
[     I have dreamed of doing this since I owned a NeXT cube in the
[ late 80's.  I'm sure there are others here that are interested too.
[ Thanks for sharing this inspiring work.
[ Jody


(Message sent Wed 10 May 2023, 15:06:15 GMT, from time zone GMT-0700.)

Key Words in Subject:  Audio, Converting, MIDI, Open, Project, Source

Home    Archives    Calendar    Gallery    Store    Links    Info   


Enter text below to search the MMD Website with Google



CONTACT FORM: Click HERE to write to the editor, or to post a message about Mechanical Musical Instruments to the MMD

Unless otherwise noted, all opinions are those of the individual authors and may not represent those of the editors. Compilation copyright 1995-2024 by Jody Kravitz.

Please read our Republication Policy before copying information from or creating links to this web site.

Click HERE to contact the webmaster regarding problems with the website.

Please support publication of the MMD by donating online

Please Support Publication of the MMD with your Generous Donation

Pay via PayPal

No PayPal account required

                                     
Translate This Page