Sign in to follow this  
dantef

generating 3d avatar from 2d photographs

Recommended Posts

dantef    100
hello there. i have a question,how are 3d photo realistic avatars generated from 2d photograph(s)?i saw a video on "virtual relay" where the user uploads photographs and a 3d photo realistic avatar is generated.how s this done?also, if anyone know s how this can be done in c++,some pointers would be nice.thank you.

Share this post


Link to post
Share on other sites
Bacterius    13165
I suppose they use some kind of heuristic to generate depth information from the 2D image, and then render the resullting scene in a 3D environment, creating the illusion of depth. I am pretty sure this is nontrivial to do.

Or maybe something else. Can you show a few examples of 2D photographs and their resulting 3D avatar?

Share this post


Link to post
Share on other sites
lauris71    841
I think first you need good face-detection algorithm that should work from any angle (from frontal to profile) and also determine the functional parts of face (eyes, moth, nose, ears, hair...)
Then you need good deformable face model that can be morphed into most realistic human faces using small fixed number of morph targets.
Then you have standard optimization problem of finding specific face morph (plus hairstyle + skin color + lighting + ...) that will give the closest result to your photograph. Although I am pretty sure that real algorithms use many shortcuts because finding the global optimum is too difficult.

Share this post


Link to post
Share on other sites
Antheus    2409
General topic is [url="http://en.wikipedia.org/wiki/Photogrammetry"]photogrammetry[/url].

OpenCV is an established library used for machine vision today. Search for "scene reconstruction" or "3D reconstruction" as well.

There is no simple way to do it, field is still under active research and even the simplest approaches require fairly advanced math.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Sign in to follow this