Jump to content
  • Advertisement
Melodrive

Music We built an AI music system that lets devs with no musical skills quickly create adaptive music in realtime.

Recommended Posts

Over the last 1.5yrs, I've worked with my colleagues on Melodrive, an AI music engine that enables people with limited to no musical skills to easily create highly adaptive music. The music engine uses AI to generate music from scratch, in realtime. The music smoothly transitions between different emotional states. We're planning on releasing the engine for free to indies. This means that indies can quickly get a soundtrack, which is more dynamic than anything that exists today on the market - composers included! 

We’ve just released four Melodrive tech demos. These showcase Melodrive's AI music potential across a range of experiences from VR to music branding. You can download the demos directly from our website here: http://melodrive.com You can also sign up to become an alpha tester.

Hope this may be of interest to you!

 

Share this post


Link to post
Share on other sites
Advertisement

While I appreciate all of the effort and systems that go into AI generated music, the actual music itself rarely works for me as a listener or as a player. AI generated music could work in smaller doses, mixed in with more traditionally composed music. But for most games I know of (and most players I've talked to) seem to want more structured soundtracks that can red thread the main theme (or themes) into various points in a game. Best of luck though! Sorry to not be more excited about it but that could just be my own personal bias. 

Share this post


Link to post
Share on other sites
Just now, nsmadsen said:

While I appreciate all of the effort and systems that go into AI generated music, the actual music itself rarely works for me as a listener or as a player. AI generated music could work in smaller doses, mixed in with more traditionally composed music. But for most games I know of (and most players I've talked to) seem to want more structured soundtracks that can red thread the main theme (or themes) into various points in a game. Best of luck though! Sorry to not be more excited about it but that could just be my own personal bias. 

Hey nsmadsen, thanks for the thoughtful feedback! We're actually addressing the issue of coherence and self-reference throughout a soundtrack. I very well know that so far most of the generative music systems lack on that point. To address that, all the music that Melodrive generates is built around the idea of a musical theme. A musical theme can be implemented into a number of different styles/emotions (in realtime) and attached to game objects and locations. Moving forward, we'll also try to implement concurrent musical themes in the same musical setting, if say for example, the boss and the protagonist, with their unique themes, are both in the same scene.

Apart from being AI researchers, we all have a strong musical background and are trying to have our AI "think" as an opera/video game composer would think. We definitely don't want to replace composers, rather we would love to arrive at a point where the composers can direct the AI in order to create highly adaptive music which is not possible today, given the obvious limited resources of a composer. We call this deep adaptive music. With deep adaptive music, human composers/devs can provide the core musical ideas to the AI, which then implements these in realtime in order to fit the non-linear experience at any time. Hope this clarifies our approach :)

Share this post


Link to post
Share on other sites

 

10 minutes ago, Melodrive said:

We're actually addressing the issue of coherence and self-reference throughout a soundtrack. I very well know that so far most of the generative music systems lack on that point. To address that, all the music that Melodrive generates is built around the idea of a musical theme.

Interesting! Do you have any samples of this that we can hear now? Or is this still in development? 

Share this post


Link to post
Share on other sites

You can take a look at our demos at  http://melodrive.com. There are also short video trailers on the website, so you don't need to download them. However, the demos are relatively simple use cases, so they don't really show the full range of possibilities of the system. (We kept them simple, as we already found that people outside of video game music has a difficult time grasping what we're doing!). "Oceania" and "SoundSlides", show the emotional change in the same style with same musical theme. With "WorldMusic", you can listen to the same musical theme passed through different styles. In "LightSynth" you can see how users may directly affect the emotional state of the music, always based on the same musical theme. Unfortunately, we don't have a demo that showcases multiple musical themes.

Share this post


Link to post
Share on other sites

I think the concept is a wonderful idea but the examples that are on that demo reel need a LOT of work. I seems that it would benefit you to have some long and in-depth conversations with people who understand how music structured and how arrangements are built. Going off what I'm hearing on that video, your  AI has got to be infinitely more refined before its going to become a usable tool, not to mention a sellable one. 

Kudos for making the effort to explore the use of AI in music. Keep at it! I hope you guys get there :) Neat project.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

  • Advertisement
×

Important Information

By using GameDev.net, you agree to our community Guidelines, Terms of Use, and Privacy Policy.

We are the game development community.

Whether you are an indie, hobbyist, AAA developer, or just trying to learn, GameDev.net is the place for you to learn, share, and connect with the games industry. Learn more About Us or sign up!

Sign me up!