Jump to content
Site Stability Read more... ×
  • Advertisement
Sign in to follow this  

Realtime musical tone analysis library

This topic is 2822 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

I am working on a game in which I want to use my cello as an input device. I play cello to generate and control the game world, and the audience uses Xbox controllers to play with/against me.

Now it is easy enough to read microphone input from my cello to my game, but what I really want to know is which notes I play and when notes start and end.

So here's the question: are there any libraries that can do real-time waveform analysis and tell me what notes are being played? Either in the form of a VST (FMOD can use VSTs, as far as I know), or as a separate library that I can call from C++. So far I have not found something suitable, while I know this should technically be possible: Rocksmith and guitar synths must use the same kind of technology.

Bonus features (not necessary, but would be nice to have):
-volume envelope within the note
-how much vibrato there is
-able to recognise very fast notes
-can recognise two-note chords (cello cannot do more than two notes at a time)

So, does anyone have any suggestions for libraries that can do this, or an approach for this?

Thanks in advance!

Share this post

Link to post
Share on other sites
Sign in to follow this  

  • Advertisement

Important Information

By using GameDev.net, you agree to our community Guidelines, Terms of Use, and Privacy Policy.

GameDev.net is your game development community. Create an account for your GameDev Portfolio and participate in the largest developer community in the games industry.

Sign me up!