Sign in to follow this  
adam17

OpenGL object picking

Recommended Posts

adam17    227
ive been looking around the net for explanations on object picking in opengl. unfortunately they seem all a little too tedious (compared to what i came up with) or imprecise. some articles ive read mention that the selection buffer in opengl only offers 4bits for color. i came up with the idea to store a color index with each object i draw into the buffer. as im storing the objects i will increment a 24bit variable (or 3 ints). red would be first, then add green into the mix, and finally blue. this would give me up to 2^24 colors. i doubt ill be putting more than 16 million triangles into a scene at once, so color repetition doesnt seem to be a problem. when i go to point the cursor, i can do a real quick glReadPixels() of a 1x1 pixel to get the color that was found. using that color will give me the offset into the array of objects. i cant see any flaws in this plan. if anybody has experimented with this in the past, or has heard of flaws, could you let me know? id hate to spend a lot of time on this only to find out that its performance blows :P thanks -adam

Share this post


Link to post
Share on other sites
remdul    176
Yes, this works. I've done that before, but there are a few flaws.

Not all cards may render colors exact, meaning that say RGB(255,33,23) may be read back as RGB(255,34,23). Though in general, I've never had this problem as long as you disable texturing, lighting, multisample etc etc. Make sure to set the color with glColor3ub() instead of glColor3f().

Another issue is that when the user runs the OS in 16-bit color mode, it will be broken as colors will be modified.

Reading back stuff (glReadPixels) stalls the pipeline, so it may not be very fast compared to a raytest on the CPU, but if you only do the picking routine once every while when the user clicks inside the viewport and not constantly there should be performance issue. If you want something like a hover effect where the mouse cursor changes, you can keep a copy of the entire framebuffer on the application side (read back the framebuffer only if the scene changes).

Share this post


Link to post
Share on other sites
adam17    227
performance isnt much of an issue. im trying to design a terrain editor. i like the idea of saving a copy of the framebuffer whenever the scene changes. if that can let me get rid of using glReadPixels(), it will definitely help speed it up. i plan to disable everything but coloring, like texturing, lighting, multisampling and shaders.

i appreciate the help!

Share this post


Link to post
Share on other sites
adam17    227
Quote:
Original post by remdul
Reading back stuff (glReadPixels) stalls the pipeline, so it may not be very fast compared to a raytest on the CPU, but if you only do the picking routine once every while when the user clicks inside the viewport and not constantly there should be performance issue. If you want something like a hover effect where the mouse cursor changes, you can keep a copy of the entire framebuffer on the application side (read back the framebuffer only if the scene changes).


how exactly would i go about doing raytesting? do you know of any places i can read up on it?

Share this post


Link to post
Share on other sites
Zipster    2359
I'm personally not a huge fan of the item buffer method, for a number of reasons:

1) Along the lines of what remdul said, all but the latest graphics cards (namely the G80) work exclusive with floating-point values, meaning that there's a chance you won't get exact equality when comparing items or experience inconsistent behavior across hardware.

2) Any render-based method can potentially suffer from Z-fighting on distant objects.

3) You only get pixel-perfect selection. While this can be beneficial if there are many objects real close together or stacked on top of each other, if the object is really far away or at such an angle that only a tiny sliver is visible, it's difficult to select.

3) You'd need to either render your objects again in a second pass to the item buffer or require MRT support to do it in a single pass (which I hear can be real slow on some cards).

4) If you wanted to select multiple objects ala a selection rectangle, you'd have to iterate over each pixel in the returned item buffer and merge their values into a unique list. Also, it would be impossible to select completely hidden objects should that be something you want to add later.

The only real benefit is that it scales extremely well when you have a lot of objects in the scene. Instead of performing a ray-object intersection test for every object, you just render them and only the top-most ones are selectable. The graphics card can tear through simple flat-shaded triangles that have no special shaders or other processing like nobody's business. And I suppose you could always use depth peeling to get more objects underneath the selection.

You can probably just Google for more information on ray casting and ray-picking, or ray-sphere/ray-triangle/ray-object etc. intersection references. For selecting against a frustum (which is what you get when you back-project a selection rectangle), look up the SAT test.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Sign in to follow this  

  • Similar Content

    • By markshaw001
      Hi i am new to this forum  i wanted to ask for help from all of you i want to generate real time terrain using a 32 bit heightmap i am good at c++ and have started learning Opengl as i am very interested in making landscapes in opengl i have looked around the internet for help about this topic but i am not getting the hang of the concepts and what they are doing can some here suggests me some good resources for making terrain engine please for example like tutorials,books etc so that i can understand the whole concept of terrain generation.
       
    • By KarimIO
      Hey guys. I'm trying to get my application to work on my Nvidia GTX 970 desktop. It currently works on my Intel HD 3000 laptop, but on the desktop, every bind textures specifically from framebuffers, I get half a second of lag. This is done 4 times as I have three RGBA textures and one depth 32F buffer. I tried to use debugging software for the first time - RenderDoc only shows SwapBuffers() and no OGL calls, while Nvidia Nsight crashes upon execution, so neither are helpful. Without binding it runs regularly. This does not happen with non-framebuffer binds.
      GLFramebuffer::GLFramebuffer(FramebufferCreateInfo createInfo) { glGenFramebuffers(1, &fbo); glBindFramebuffer(GL_FRAMEBUFFER, fbo); textures = new GLuint[createInfo.numColorTargets]; glGenTextures(createInfo.numColorTargets, textures); GLenum *DrawBuffers = new GLenum[createInfo.numColorTargets]; for (uint32_t i = 0; i < createInfo.numColorTargets; i++) { glBindTexture(GL_TEXTURE_2D, textures[i]); GLint internalFormat; GLenum format; TranslateFormats(createInfo.colorFormats[i], format, internalFormat); // returns GL_RGBA and GL_RGBA glTexImage2D(GL_TEXTURE_2D, 0, internalFormat, createInfo.width, createInfo.height, 0, format, GL_FLOAT, 0); glTexParameteri(GL_TEXTURE_2D, GL_TEXTURE_MAG_FILTER, GL_NEAREST); glTexParameteri(GL_TEXTURE_2D, GL_TEXTURE_MIN_FILTER, GL_NEAREST); DrawBuffers[i] = GL_COLOR_ATTACHMENT0 + i; glBindTexture(GL_TEXTURE_2D, 0); glFramebufferTexture(GL_FRAMEBUFFER, GL_COLOR_ATTACHMENT0 + i, textures[i], 0); } if (createInfo.depthFormat != FORMAT_DEPTH_NONE) { GLenum depthFormat; switch (createInfo.depthFormat) { case FORMAT_DEPTH_16: depthFormat = GL_DEPTH_COMPONENT16; break; case FORMAT_DEPTH_24: depthFormat = GL_DEPTH_COMPONENT24; break; case FORMAT_DEPTH_32: depthFormat = GL_DEPTH_COMPONENT32; break; case FORMAT_DEPTH_24_STENCIL_8: depthFormat = GL_DEPTH24_STENCIL8; break; case FORMAT_DEPTH_32_STENCIL_8: depthFormat = GL_DEPTH32F_STENCIL8; break; } glGenTextures(1, &depthrenderbuffer); glBindTexture(GL_TEXTURE_2D, depthrenderbuffer); glTexImage2D(GL_TEXTURE_2D, 0, depthFormat, createInfo.width, createInfo.height, 0, GL_DEPTH_COMPONENT, GL_FLOAT, 0); glTexParameteri(GL_TEXTURE_2D, GL_TEXTURE_MAG_FILTER, GL_NEAREST); glTexParameteri(GL_TEXTURE_2D, GL_TEXTURE_MIN_FILTER, GL_NEAREST); glBindTexture(GL_TEXTURE_2D, 0); glFramebufferTexture(GL_FRAMEBUFFER, GL_DEPTH_ATTACHMENT, depthrenderbuffer, 0); } if (createInfo.numColorTargets > 0) glDrawBuffers(createInfo.numColorTargets, DrawBuffers); else glDrawBuffer(GL_NONE); if (glCheckFramebufferStatus(GL_FRAMEBUFFER) != GL_FRAMEBUFFER_COMPLETE) std::cout << "Framebuffer Incomplete\n"; glBindFramebuffer(GL_FRAMEBUFFER, 0); width = createInfo.width; height = createInfo.height; } // ... // FBO Creation FramebufferCreateInfo gbufferCI; gbufferCI.colorFormats = gbufferCFs.data(); gbufferCI.depthFormat = FORMAT_DEPTH_32; gbufferCI.numColorTargets = gbufferCFs.size(); gbufferCI.width = engine.settings.resolutionX; gbufferCI.height = engine.settings.resolutionY; gbufferCI.renderPass = nullptr; gbuffer = graphicsWrapper->CreateFramebuffer(gbufferCI); // Bind glBindFramebuffer(GL_DRAW_FRAMEBUFFER, fbo); // Draw here... // Bind to textures glActiveTexture(GL_TEXTURE0); glBindTexture(GL_TEXTURE_2D, textures[0]); glActiveTexture(GL_TEXTURE1); glBindTexture(GL_TEXTURE_2D, textures[1]); glActiveTexture(GL_TEXTURE2); glBindTexture(GL_TEXTURE_2D, textures[2]); glActiveTexture(GL_TEXTURE3); glBindTexture(GL_TEXTURE_2D, depthrenderbuffer); Here is an extract of my code. I can't think of anything else to include. I've really been butting my head into a wall trying to think of a reason but I can think of none and all my research yields nothing. Thanks in advance!
    • By Adrianensis
      Hi everyone, I've shared my 2D Game Engine source code. It's the result of 4 years working on it (and I still continue improving features ) and I want to share with the community. You can see some videos on youtube and some demo gifs on my twitter account.
      This Engine has been developed as End-of-Degree Project and it is coded in Javascript, WebGL and GLSL. The engine is written from scratch.
      This is not a professional engine but it's for learning purposes, so anyone can review the code an learn basis about graphics, physics or game engine architecture. Source code on this GitHub repository.
      I'm available for a good conversation about Game Engine / Graphics Programming
    • By C0dR
      I would like to introduce the first version of my physically based camera rendering library, written in C++, called PhysiCam.
      Physicam is an open source OpenGL C++ library, which provides physically based camera rendering and parameters. It is based on OpenGL and designed to be used as either static library or dynamic library and can be integrated in existing applications.
       
      The following features are implemented:
      Physically based sensor and focal length calculation Autoexposure Manual exposure Lense distortion Bloom (influenced by ISO, Shutter Speed, Sensor type etc.) Bokeh (influenced by Aperture, Sensor type and focal length) Tonemapping  
      You can find the repository at https://github.com/0x2A/physicam
       
      I would be happy about feedback, suggestions or contributions.

    • By altay
      Hi folks,
      Imagine we have 8 different light sources in our scene and want dynamic shadow map for each of them. The question is how do we generate shadow maps? Do we render the scene for each to get the depth data? If so, how about performance? Do we deal with the performance issues just by applying general methods (e.g. frustum culling)?
      Thanks,
       
  • Popular Now