Sign in to follow this  
opengl_beginner

OpenGL Spherical Harmonics - Sphere maps, cube maps and user interaction

Recommended Posts

Hi guys! [img]http://public.gamedev.net//public/style_emoticons/default/smile.png[/img]


This is my very first post on this forum [img]http://public.gamedev.net//public/style_emoticons/default/smile.png[/img]


I'm very much new to OpenGL and I'm currently starting my newest adventure in this field - Spherical Harmonics.
The idea I would like to implement it the following:

[quote]
A user interface (OpenGL or MATLAB), which displays an illumination model and a scene containing synthetic objects.
The user gets to rotate/move/play around with the illumination model and, as a result, the image is rendered under the chosen illumination.
[/quote]


I have read through quite a few previous posts on this topic and googled the web (this is the most relevant project page: [url="http://graphics.stanford.edu/papers/envmap/"]Link[/url]), but there are still a few open questions.

1) What is the interpretation of a spherical harmonic model - it models the incoming light for each pixel on the surface, i.e. irradiance. And rendering is done based on the outgoing lighting power, i.e. radiance. Is this correct?

2) SH are said to be good for image with only low-frequency components. Why so? Could anyone provide with an example image, which is NOT suitable for SH modeling?

3) Spherical harmonics can be represented using cube maps or spheres. What is the difference - is one representation better than the other? Are there any other options - e.g. triangles, octaeders, ellipses, etc.?

4) Light probes can be used as environments maps ([url="http://www.pauldebevec.com/Probes/"]Link[/url]). Are there any other options?

5) I came across an excellent tutorial by Robin Green ([url="http://www.research.scea.com/gdc2003/spherical-harmonic-lighting.html"]Link).[/url] I also found a nice implementation of it, which I would like to edit: [url="http://www.paulsprojects.net/opengl/sh/sh.html"]Link[/url]
Unfortunately though, I am not quite sure how/where to get started.
Any suggestions?


Looking forward to your response! [img]http://public.gamedev.net//public/style_emoticons/default/smile.png[/img] Edited by opengl_beginner

Share this post


Link to post
Share on other sites
Ashaman73    13715
In short, sperical harmonics are way to compress incoming light. A very simple spherical harmonic would be a vector and a cone (4 parameters) which could be used to tell from which direction light up to a certain angle (cone) is coming. The vector AO version is therefore more or less a spherical harmonic, but the issue is, that it can only describe the incoming light from a single direction.

Now, you can increase the accuracy of this by increasing the resolution of a spherical harmonic and this is memory intensive (+more arithmetic). So, if you want to keep it at a sane level (i.e 9 parameters) you only have a resolution which can handle low-frequency distribution of incoming light in a satisfying way.

Taking a cube map into account you could map the incoming light on this cube map instead of a sphere, which would give you an incredible resolution (=light probe).

The issue is now the task you want to solve. A single spherical harmonic at a single point saved as cube map is a great way to adjust the lighting of a character etc. but for global illumination you want it for each texel, much like AO. Simple precalculated AO has only a value of 1 byte, a 9 component SH with 16bit floats has 18x memory consumption of a simple AO term which is quite heavy.

Hope it helps you to get a better feeling for SH. Edited by Ashaman73

Share this post


Link to post
Share on other sites
Hey Ashaman!


I think I understand it better everytime I discuss it.
It'll become even better when I start writing code for it.

I would like to start the following way:

Display arbitrary objects (cubes, spheres, rings, ellipses, etc.) in a scene and have them rendered using SH.
Any ideas on how I should start?

Thanks!

Share this post


Link to post
Share on other sites
Ashaman73    13715
[quote name='opengl_beginner' timestamp='1351511030' post='4995016']
Display arbitrary objects (cubes, spheres, rings, ellipses, etc.) in a scene and have them rendered using SH.
Any ideas on how I should start?
[/quote]
I'm not sure if you really understand what SHs are. The are a mathematically construct like vectors. So, you are asking how to renderer a cube using vectors ?

What is your goal ? SH are often used in lighting calculation, but there are really many options how to use them. AO like terms, light maps, light probes, LVP, these are different techniques which uses SHs and vectors, so where do you want to start ?

Share this post


Link to post
Share on other sites
Hi again!

This project shows what I would like to do: [url="http://www.yasrt.org/shlighting/"]http://www.yasrt.org/shlighting/[/url]

These are the steps I have been thinking of:
1) Compute SH coefficients for different light probes (e.g. Grace Cathedrale)
2) Generate a sphere, which represents the SH illumination model
3) Create a 3D object (e.g. aring)
4) Fix albedo = 1
5) Rendering the ring under Grace Cathedrale illumination
6) Rotate SH model, and as a result, the scene should change in real-time

I've managed to carry out step 1) using the prefilter.c function given [url="http://graphics.stanford.edu/papers/envmap/prefilter.c"]here.[/url]
Now - how do I create a sphere that represents the model (similar to aforementioned project)?

Thanks!

Share this post


Link to post
Share on other sites
Ashaman73    13715
[quote name='opengl_beginner' timestamp='1351580751' post='4995314']
These are the steps I have been thinking of:
1) Compute SH coefficients for different light probes (e.g. Grace Cathedrale)
2) Generate a sphere, which represents the SH illumination model
3) Create a 3D object (e.g. aring)
4) Fix albedo = 1
5) Rendering the ring under Grace Cathedrale illumination
6) Rotate SH model, and as a result, the scene should change in real-time
[/quote]
This sounds more like homework then musing about a technique [img]http://public.gamedev.net//public/style_emoticons/default/wink.png[/img]

Nevertheless, the webpage you posted got a lot of links, including links to source code and books. I can't explain spherical harmonics myself beyond what I've written, so best to get the book from the library [img]http://public.gamedev.net//public/style_emoticons/default/biggrin.png[/img]

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Sign in to follow this  

  • Similar Content

    • By tyhender
      Hello, my name is Mark. I'm hobby programmer. 
      So recently,I thought that it's good idea to find people to create a full 3D engine. I'm looking for people experienced in scripting 3D shaders and implementing physics into engine(game)(we are going to use the React physics engine). 
      And,ye,no money =D I'm just looking for hobbyists that will be proud of their work. If engine(or game) will have financial succes,well,then maybe =D
      Sorry for late replies.
      I mostly give more information when people PM me,but this post is REALLY short,even for me =D
      So here's few more points:
      Engine will use openGL and SDL for graphics. It will use React3D physics library for physics simulation. Engine(most probably,atleast for the first part) won't have graphical fron-end,it will be a framework . I think final engine should be enough to set up an FPS in a couple of minutes. A bit about my self:
      I've been programming for 7 years total. I learned very slowly it as "secondary interesting thing" for like 3 years, but then began to script more seriously.  My primary language is C++,which we are going to use for the engine. Yes,I did 3D graphics with physics simulation before. No, my portfolio isn't very impressive. I'm working on that No,I wasn't employed officially. If anybody need to know more PM me. 
       
    • By Zaphyk
      I am developing my engine using the OpenGL 3.3 compatibility profile. It runs as expected on my NVIDIA card and on my Intel Card however when I tried it on an AMD setup it ran 3 times worse than on the other setups. Could this be a AMD driver thing or is this probably a problem with my OGL code? Could a different code standard create such bad performance?
    • By Kjell Andersson
      I'm trying to get some legacy OpenGL code to run with a shader pipeline,
      The legacy code uses glVertexPointer(), glColorPointer(), glNormalPointer() and glTexCoordPointer() to supply the vertex information.
      I know that it should be using setVertexAttribPointer() etc to clearly define the layout but that is not an option right now since the legacy code can't be modified to that extent.
      I've got a version 330 vertex shader to somewhat work:
      #version 330 uniform mat4 osg_ModelViewProjectionMatrix; uniform mat4 osg_ModelViewMatrix; layout(location = 0) in vec4 Vertex; layout(location = 2) in vec4 Normal; // Velocity layout(location = 3) in vec3 TexCoord; // TODO: is this the right layout location? out VertexData { vec4 color; vec3 velocity; float size; } VertexOut; void main(void) { vec4 p0 = Vertex; vec4 p1 = Vertex + vec4(Normal.x, Normal.y, Normal.z, 0.0f); vec3 velocity = (osg_ModelViewProjectionMatrix * p1 - osg_ModelViewProjectionMatrix * p0).xyz; VertexOut.velocity = velocity; VertexOut.size = TexCoord.y; gl_Position = osg_ModelViewMatrix * Vertex; } What works is the Vertex and Normal information that the legacy C++ OpenGL code seem to provide in layout location 0 and 2. This is fine.
      What I'm not getting to work is the TexCoord information that is supplied by a glTexCoordPointer() call in C++.
      Question:
      What layout location is the old standard pipeline using for glTexCoordPointer()? Or is this undefined?
       
      Side note: I'm trying to get an OpenSceneGraph 3.4.0 particle system to use custom vertex, geometry and fragment shaders for rendering the particles.
    • By markshaw001
      Hi i am new to this forum  i wanted to ask for help from all of you i want to generate real time terrain using a 32 bit heightmap i am good at c++ and have started learning Opengl as i am very interested in making landscapes in opengl i have looked around the internet for help about this topic but i am not getting the hang of the concepts and what they are doing can some here suggests me some good resources for making terrain engine please for example like tutorials,books etc so that i can understand the whole concept of terrain generation.
       
    • By KarimIO
      Hey guys. I'm trying to get my application to work on my Nvidia GTX 970 desktop. It currently works on my Intel HD 3000 laptop, but on the desktop, every bind textures specifically from framebuffers, I get half a second of lag. This is done 4 times as I have three RGBA textures and one depth 32F buffer. I tried to use debugging software for the first time - RenderDoc only shows SwapBuffers() and no OGL calls, while Nvidia Nsight crashes upon execution, so neither are helpful. Without binding it runs regularly. This does not happen with non-framebuffer binds.
      GLFramebuffer::GLFramebuffer(FramebufferCreateInfo createInfo) { glGenFramebuffers(1, &fbo); glBindFramebuffer(GL_FRAMEBUFFER, fbo); textures = new GLuint[createInfo.numColorTargets]; glGenTextures(createInfo.numColorTargets, textures); GLenum *DrawBuffers = new GLenum[createInfo.numColorTargets]; for (uint32_t i = 0; i < createInfo.numColorTargets; i++) { glBindTexture(GL_TEXTURE_2D, textures[i]); GLint internalFormat; GLenum format; TranslateFormats(createInfo.colorFormats[i], format, internalFormat); // returns GL_RGBA and GL_RGBA glTexImage2D(GL_TEXTURE_2D, 0, internalFormat, createInfo.width, createInfo.height, 0, format, GL_FLOAT, 0); glTexParameteri(GL_TEXTURE_2D, GL_TEXTURE_MAG_FILTER, GL_NEAREST); glTexParameteri(GL_TEXTURE_2D, GL_TEXTURE_MIN_FILTER, GL_NEAREST); DrawBuffers[i] = GL_COLOR_ATTACHMENT0 + i; glBindTexture(GL_TEXTURE_2D, 0); glFramebufferTexture(GL_FRAMEBUFFER, GL_COLOR_ATTACHMENT0 + i, textures[i], 0); } if (createInfo.depthFormat != FORMAT_DEPTH_NONE) { GLenum depthFormat; switch (createInfo.depthFormat) { case FORMAT_DEPTH_16: depthFormat = GL_DEPTH_COMPONENT16; break; case FORMAT_DEPTH_24: depthFormat = GL_DEPTH_COMPONENT24; break; case FORMAT_DEPTH_32: depthFormat = GL_DEPTH_COMPONENT32; break; case FORMAT_DEPTH_24_STENCIL_8: depthFormat = GL_DEPTH24_STENCIL8; break; case FORMAT_DEPTH_32_STENCIL_8: depthFormat = GL_DEPTH32F_STENCIL8; break; } glGenTextures(1, &depthrenderbuffer); glBindTexture(GL_TEXTURE_2D, depthrenderbuffer); glTexImage2D(GL_TEXTURE_2D, 0, depthFormat, createInfo.width, createInfo.height, 0, GL_DEPTH_COMPONENT, GL_FLOAT, 0); glTexParameteri(GL_TEXTURE_2D, GL_TEXTURE_MAG_FILTER, GL_NEAREST); glTexParameteri(GL_TEXTURE_2D, GL_TEXTURE_MIN_FILTER, GL_NEAREST); glBindTexture(GL_TEXTURE_2D, 0); glFramebufferTexture(GL_FRAMEBUFFER, GL_DEPTH_ATTACHMENT, depthrenderbuffer, 0); } if (createInfo.numColorTargets > 0) glDrawBuffers(createInfo.numColorTargets, DrawBuffers); else glDrawBuffer(GL_NONE); if (glCheckFramebufferStatus(GL_FRAMEBUFFER) != GL_FRAMEBUFFER_COMPLETE) std::cout << "Framebuffer Incomplete\n"; glBindFramebuffer(GL_FRAMEBUFFER, 0); width = createInfo.width; height = createInfo.height; } // ... // FBO Creation FramebufferCreateInfo gbufferCI; gbufferCI.colorFormats = gbufferCFs.data(); gbufferCI.depthFormat = FORMAT_DEPTH_32; gbufferCI.numColorTargets = gbufferCFs.size(); gbufferCI.width = engine.settings.resolutionX; gbufferCI.height = engine.settings.resolutionY; gbufferCI.renderPass = nullptr; gbuffer = graphicsWrapper->CreateFramebuffer(gbufferCI); // Bind glBindFramebuffer(GL_DRAW_FRAMEBUFFER, fbo); // Draw here... // Bind to textures glActiveTexture(GL_TEXTURE0); glBindTexture(GL_TEXTURE_2D, textures[0]); glActiveTexture(GL_TEXTURE1); glBindTexture(GL_TEXTURE_2D, textures[1]); glActiveTexture(GL_TEXTURE2); glBindTexture(GL_TEXTURE_2D, textures[2]); glActiveTexture(GL_TEXTURE3); glBindTexture(GL_TEXTURE_2D, depthrenderbuffer); Here is an extract of my code. I can't think of anything else to include. I've really been butting my head into a wall trying to think of a reason but I can think of none and all my research yields nothing. Thanks in advance!
  • Popular Now