Sign in to follow this  

OpenGL SAPI with OpenGL in RealTime

Recommended Posts


I am currently trying to make use of the SAPI program for a lip sync animation on a human head. At the moment, I am able to animate the figure by using different blend shapes for the mouth, so the easy part is down.

However, I have not been able to figure out how to use the SAPI API in realtime in graphical applications.

Currently I have this in my main glut loop to test the speech interface

hr = CoCreateInstance(CLSID_SpVoice, NULL, CLSCTX_ALL, IID_ISpVoice, (void **)&pVoice);
hr = pVoice->Speak(L"Microsoft Speech A P I Initiated", SPF_ASYNC, NULL);
hr = pVoice->Release();
pVoice = NULL;

What kind of properties should I be looking at with the Speech API in order to do some work with real time lip sync? The accuracy of the lips are not so important right now(visemes, phonemes, etc.), it's more important that when a line of text is read I can interact with my characters geometry in realtime during the speech. Any good examples out there?

Thanks for your help.

Share this post

Link to post
Share on other sites

Correct! The solution was to just run SAPI function in a new thread. I'm not positive this is the best implementation, but it worked well enough for a small Demo.

Share this post

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Sign in to follow this