Jump to content
  • Advertisement

Archived

This topic is now archived and is closed to further replies.

_Danneman_

Analyzing mp3-file for lipsync ?

This topic is 5302 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

Hi guys, I have a loose idea in my head and I would like to check with some experienced sound-gurus (thats you, if you didnt get that ) if its even possible before I go ahead with all the research and learning and constructing. Step 1) I want to check an mp3-file (voice talking) for a predefined set (lets say five) of phonetic sounds. It shouldnt matter who''s voice it is, or what volume or speed it is spoken with. Is it possible to distinguish these phonetics with for instance, Cubase? Step 2) I want to export every distinguished phonetic sound into a simple textfile. Every phonetic sound should be represented by a number (1-5), and the mp3-file should be checked four times every second for the current phonetic sound. Meaning that if I had a five second mp3-file I would end up with a textfile containing a string with (4 times/second * 5 seconds =) 20 numbers ranging from 1-5. Is this possible? Or am I wasting your/my time? Thanks

Share this post


Link to post
Share on other sites
Advertisement
have hope... i know there''s a program out there that does this, but i have no clue what the name of it is. it was free too, that or shareware/trial something.

keep searching.

Share this post


Link to post
Share on other sites
1) Yes I do believe it''s possible, but I don''t know how

2) That isn''t the best file format. It would probably work better if you had lip sync stuff that lasted for any length of time (measured in samples or milliseconds), rather than just exactly one second (which is fairly slow in terms of how fast people talk).

Perhaps a list of "length of time" "phonetic" pairs?

Share this post


Link to post
Share on other sites
Andrew Russell:
Yes, thats probably a better solution in the long run, if and when I take the rudimentary system I have in mind to a higher level.

Rocket05:
Oh, a program like that would be great. Im going blind from googling after something like that and trying different downloads from download.com, so if you remember the name of it, please let me know.

Share this post


Link to post
Share on other sites
I remember hearing of a program like that also, but once again, I''m not too sure what it was called.

Some thoughts on it though: the file you use (I''m geussing at this) would prolly have to be speech only. Seeing as a computer isn''t quite smart enough to recognize the difference between a distortion guitar and a persons voice. Everything is just a big binary waveform that it analyzes within preset parameters.

Share this post


Link to post
Share on other sites

  • Advertisement
×

Important Information

By using GameDev.net, you agree to our community Guidelines, Terms of Use, and Privacy Policy.

We are the game development community.

Whether you are an indie, hobbyist, AAA developer, or just trying to learn, GameDev.net is the place for you to learn, share, and connect with the games industry. Learn more About Us or sign up!

Sign me up!