Sign in to follow this  
wolfscaptain

OpenGL Making an OpenGL wrapper

Recommended Posts

wolfscaptain    200
I got to the phase when one gets sick of all the calls to OpenGL all over the place. Especially binding textures, buffers, vertex attributes, and uniforms.
My plan is to make an easy to use wrapper above OpenGL, but until now I only made very thin wrappers that were more for convenience, this time I really want to remove OpenGL from my client code.

I thought about making some sort of an Effect object that will replace shader objects. When you create an effect, you request a series of features, for example "color(red),texture,pongShading", which will make it have those things in the internal shader itself, and will create appropriate uniforms for the shader.
What I got stuck is at populating the uniforms - I still can't really see a decent way to make them nicer.

The best I could think about buffers and vertex attributes is to make a Buffer object that will hold in it a list of required attributes, the type of function needed to draw with the required flags (e.g. "drawArrays" with "Triangles"), and the data required for the function, such as the length of vertex data for drawArrays, and the length of indices for drawElements.
While this makes drawing static meshes nicer, it looks like it will be only more bothersome for dynamic meshes that change.

Does anyone here have experience with making a _nice_ wrapper for OpenGL and can share his thoughts?
Thanks.

Share this post


Link to post
Share on other sites
L. Spiro    25638
If you need a testament to the quality of one’s OpenGL wrapper, I am making a next-generation [url="http://lspiroengine.com/"]game engine[/url] so I naturally want to take care on the quality of my OpenGL and Direct3D wrappers.
With very careful use of critical sections I have full multi-threaded capabilities, such as ways to bind textures so that they cannot be rebound by another thread until the current thread is done with its texture(s).
I wrote a new [url="http://lspiroengine.com/forums/viewtopic.php?f=13&t=14"]shader language[/url] (pardon the incomplete documentation; it is documented as I have time) to wrap around the OpenGL shader system and the DirectX shader systems.

I would not expect you to write a new shader language to do what you want to do, so I will try to explain how I would go about your situation. This will be a mix of what I do and what I would do.

My vertex and index buffer wrappers are as fully flexible as their API-specific buffers.
When creating a vertex buffer you will pass the attributes you want it to have and the slots for those attributes.
In HLSL, these match exactly to semantics, so I would pass POSITION0, NORMAL0, NORMAL1, etc.

Offsets for each of the attributes are calculated based on the combination of attributes. When the user is done filling the vertex buffer, he or she calls Finalize(), at which point it is transferred to OpenGL or Direct3D or wherever.
Read [url="http://lspiroengine.com/?p=49"]here[/url] for an easy way to have one class managing OpenGL resources and another acting as the generic interface for that class, which [b]never[/b] calls OpenGL functions directly.


Just as OpenGL and DirectX do, I support multiple streams with my wrappers.
In preparing for render, one or more vertex buffers will be selected and assigned to various streams.
When CFnd::Render() is called to make the final render (with an optional index buffer as a parameter), the array of active vertex buffers are notified that they are about to be used for rendering. It does not matter how many are active.
Each one connects its vertex attributes to the attributes in the currently active shader.


[code]
/**
* Prepare for rendering.
*/
LSVOID LSE_CALL COpenGlVertexBuffer::PrepareToRenderApi() {
assert( CFnd::GetShader() );
CCriticalSection::CLockerS lsLockBindBuffer( m_csCrit );
COpenGl::glBindBufferLSG( GL_ARRAY_BUFFER_ARB, m_uiVboId ); // Even if m_uiVboId is 0, that is perfect.
// Set vertex attribute locations.
for ( LSUINT32 I = m_vVertexAttribPointers.Length(); I--; ) {
const LSG_VERTEX_ATTRIB_POINTER * pvapThis = &m_vVertexAttribPointers[I];
GLint iAttrib = CFnd::GetShader()->GetAttributeLocs()[pvapThis->ui16LocClass].iLoc[pvapThis->ui16LocUsage];
COpenGl::glEnableVertexAttribArrayLSG( iAttrib );
COpenGl::glVertexAttribPointerLSG( iAttrib,
pvapThis->ui8Elements,
pvapThis->ui32Type,
pvapThis->ui8Normalized,
m_siStride,
reinterpret_cast<LSUINT8 *>(pvapThis->pvPointer) + m_ui32OffsetApi );
CFnd::AssertError();
}
}[/code]



Unfortunately, this is where you will have to deviate. My shader language fully parses input shader files, which are in a syntax I created.
When translating to GLSL, my parsers also extract information from the shader file, such as which variable (by name) is meant to connect to the vertex attribute “NORMAL1”, etc. Using this information the shader builds a table of attribute locations that the vertex buffer(s), as you can see here, uses to connect its attributes with those in the shader.


You will have to find a way to quickly and dynamically make this connection. It needs to be dynamic so that any vertex buffer will work with any shader as long as the attribute names match, in any way, the combination of vertex buffers that are active.

If you use predefined names for the variables in your shader it could work similarly to the way mine does, but you would have the restriction that those names exactly must be used. For example:
g_vPos3_0
g_vNormal3_0
g_vNormal3_1


Any of these names that are not accessed by the shader will be stripped, so you can search for all of them and build a table of only the ones that are actually there. That table could be used the way I have done with mine.

Uniforms can be done the same way. If they always use the same names you can simply keep a table of their locations and update only the ones that are actually used by the shader.
I do this in the CFnd::Render() function.


From the sounds of your framework this would be suitable, since you are only planning to use a subset of its functionality for effects that are well defined in nature and functionality.
I considered a similar thing long ago but my method for generating dynamic shaders is to have the model fill a small structure with flags that describe what properties it wants from the shader and submit that to a shader manager for the model system. The shader manager will either increase the reference count on the existing shader that matches the request or make a new one.
When a new shader is made, the same flags that were submitted are translated into macro definitions which enable some inputs and some pieces of code.
This way I only have to write one shader and it gets permutated automatically and on-the-fly. And shared, to reduce the cost of shader swapping.
This, along with the on-the-fly mix-and-match capabilities of the vertex buffers, handles changing meshes just as easily as static ones.

Hope that covers most of your bases.


L. Spiro

Share this post


Link to post
Share on other sites
wolfscaptain    200
Sadly I don't have time right now to fully read what you wrote, but I originally wanted to ask this question on your site, except I don't seem to be able to make new posts there.
What a neat coincidence that you replied :)

As you wrote, I do not want to make a full fledged wrapper to the level of writing my own shader language, but from skimming on the rest your ideas seem to work well in my mind. I'll read more thoroughly later when I have time.

Thanks.

Share this post


Link to post
Share on other sites
L. Spiro    25638
What trouble do you encounter on my site? I do need to know if others are having troubles registering or posting.

Also this topic gives me an idea for my next blog. I am taking inspiration for the topics of my blogs based on what questions people ask here so this is also just as useful for me as it is hopefully for you.
I will explain my rendering system in greater detail soon, but maybe I can help you with your immediate problem here before that.


L. Spiro

Share this post


Link to post
Share on other sites
wolfscaptain    200
There's just no way to add new topics or respond to existing ones.

The buffer idea is pretty much what I had in mind, but it means that updating the buffer essentially becomes the same thing, just as a member instead of directly (unless you had methods to the new buffer class, I guess).

I do cache my resources, so if, say, you request a shader with whatever features, it will return a cached one or create it if it doesn't exist.
My shader objects are currently a thin wrapper that has the shader ID in them, as well as all the attributes and uniforms in a hash-map, so matching uniform names dynamically shouldn't be hard (I am not explicitly giving attributes specific indices (slots?), but rather let the driver do whatever it wants).
I didn't mean there is an issue with updating uniforms (or giving them values to begin with), I just don't see a nice way to do it.

I would go and make a general mesh class, but I am currently only having simple 2D textured quads (really, having a 2D grid world is so easy to maintain), so I am not sure how to associate textures with the buffer data.

I would like to also talk about skeletal animations, but I'd rather do it in your site since it isn't really related to this subject.

Share this post


Link to post
Share on other sites
L. Spiro    25638
[quote name='phantom' timestamp='1313954584' post='4851988']
A critical section in your main render loop code? REALLY? I mean... REALLY?

(Also, 'C' prefixes on classes make my brain vomit... yay for unreadable mess \o/)
[/quote]
Actually the locker class does nothing to the critical section unless the user of the engine builds with a macro set that indicates that resources might be loaded on another thread while rendering takes place.
You may also want to consider the low overhead of ring-3 locking, which consists of only a few instructions on x86 and x64.
I currently do not load resources in a multi-threaded fashion so I am free to enable and disable the locker functionality simply to check for any discrepancies in performance. There are none.
There was a topic recently in which a guy asked why he is always told what [b]not[/b] to do, but never why. For example, why must he not allocate memory in constructors? A lot of advice floating around about performance and safety issues were once valid, but as technology advances not many people ever re-evaluate which parts of advice have changed.
Of course I am open to suggestions on any better way to make OpenGL play nicely in a fully multi-threaded environment.

Additionally, classes without the “C” prefix (programmers often enclose single characters in single quotes when writing; most curious) make me vomit and create an unreadable mess.
But my opinion on code “prettiness” is no more—or less—valid than yours.


[quote name='wolfscaptain' timestamp='1313958225' post='4851999']
There's just no way to add new topics or respond to existing ones.

The buffer idea is pretty much what I had in mind, but it means that updating the buffer essentially becomes the same thing, just as a member instead of directly (unless you had methods to the new buffer class, I guess).

I do cache my resources, so if, say, you request a shader with whatever features, it will return a cached one or create it if it doesn't exist.
My shader objects are currently a thin wrapper that has the shader ID in them, as well as all the attributes and uniforms in a hash-map, so matching uniform names dynamically shouldn't be hard (I am not explicitly giving attributes specific indices (slots?), but rather let the driver do whatever it wants).
I didn't mean there is an issue with updating uniforms (or giving them values to begin with), I just don't see a nice way to do it.

I would go and make a general mesh class, but I am currently only having simple 2D textured quads (really, having a 2D grid world is so easy to maintain), so I am not sure how to associate textures with the buffer data.

I would like to also talk about skeletal animations, but I'd rather do it in your site since it isn't really related to this subject.
[/quote]
Are you talking about the forums?
Other people have made new threads and replied after first registering. Perhaps your account is not activated?
You can PM me your user name and where you want to post and we can continue from PM. I have a feeling this topic is going to become more about coding practices and styles rather than OpenGL wrappers.

But I can add one more on-topic thing.
Textures don’t need to be associated with any buffers. They should be entirely decoupled from shaders and vertex buffers.
You can add one sampler in your shader per texture slot (typically there are 8), each with a fixed name, and the first time the shader becomes active it assigns them to their texture units.
After that you need a way only to syncronize between which slots have what [i]meaning[/i]. That is, this slot is for diffuse textures, this one for normal maps, etc. And then finally use the same “slot map” (slots here are texture [i]units[/i] in OpenGL) to put whatever diffuse texture in this slot and whatever normal-mapping texture in that slot.

This would be handled by your model class. The way I handle this is that my model class may have any number of layered textures, and on the base layer there may also be normal maps, specular maps, etc.
So I keep a slot index counter and run through every layer on the model. For each layer I check for a diffuse texture. On the base layer I also check for other types of textures. Each texture I find, in my search order, is assigned the current slot index and the slot index increases.
The locations of textures (diffuse texture in slot 0, normal map in slot 1, 2nd-layer diffuse texture in slot 2, etc.) as well as which set of texture coordinates they use (diffuse 0 and normal map 0 will take slots 0 and 1, but will both access texture [i]coordinates[/i] 0) is part of the information I send to the shader manager to get a permutation for that configuration.
My model class keeps this information as well, and uses it to properly assign the textures to their slots when rendering.


L. Spiro


[EDIT]
I have fixed your forum permissions so that you can post.
[/EDIT]

Share this post


Link to post
Share on other sites
_the_phantom_    11250
[quote name='YogurtEmperor' timestamp='1313989319' post='4852130']
I currently do not load resources in a multi-threaded fashion so I am free to enable and disable the locker functionality simply to check for any discrepancies in performance. There are none.
[/quote]

Just because you don't see any now doesn't mean they won't crop up in the future; maybe your tests right now don't get into a situation where their is high contention for the context resource.

However you have slightly bigger problem than that; OpenGL contexts are only valid in one thread at a time, so even if a thread aquires that lock unless the context is local to that thread your commands won't work anyway.

[quote]
There was a topic recently in which a guy asked why he is always told what [b]not[/b] to do, but never why. For example, why must he not allocate memory in constructors? A lot of advice floating around about performance and safety issues were once valid, but as technology advances not many people ever re-evaluate which parts of advice have changed.
[/quote]

Well, yes, I saw that thread and that advice would have pretty much ALWAYS have been bogus apart from in certain situations. Even so, work done which is of no use then is still no use now and when a better design exists which doesn't run the risk of stalling out threads due to contention then that solution is better to take.

[quote]
Of course I am open to suggestions on any better way to make OpenGL play nicely in a fully multi-threaded environment.
[/quote]

The solution is simple; one thread, and one thread only, deals with OpenGL related things per context. If your application has but one context then it should next belong to more than one thread.

All operations which are required to run on that thread are buffered into a queue and then, at some point during execution (start or end) these commands are dequed by the rendering thread and executed before it begins processing drawing commands. Note; drawing commands should do the same; process into a queue and are dequed and processed on a single thread. Firaxis applied this method to their DX9 renderer, using multiple threads to queue up work and then dequeue on a single thread, and it resulted in an improvement in frame time due to better cache usage and locality of data.

Share this post


Link to post
Share on other sites
L. Spiro    25638
I remember that (OpenGL contexts are per-thread) now. How much I have forgotten.
Indeed I will have to make a single-threaded queue. Thank you for the reminder.

I feel so out-of-shape in some parts of OpenGL.


L. Spiro

Share this post


Link to post
Share on other sites
Yours3!f    1532
[quote name='phantom' timestamp='1313954584' post='4851988']
(Also, 'C' prefixes on classes make my brain vomit... yay for unreadable mess \o/)
[/quote]

totally agreed, it is just unreadable... that little snippet reminds me of win32 programming with LPVOIDs and other stuff...

Share this post


Link to post
Share on other sites
[quote name='phantom' timestamp='1314038515' post='4852440']OpenGL contexts are only valid in one thread at a time, so even if a thread aquires that lock [...] it won't work[/quote]

That's the one thing.

Though you can easily work around OpenGL's design error by creating another context and sharing it. Contrary to common belief, this is easy, well-supported, and does not explode or eat your cat. Of course you still need proper synchronization, because binding and using a texture or buffer object that is being updated from or mapped in another thread means bad luck. Yay for [font="Courier New"]ARB_sync[/font] here.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Sign in to follow this  

  • Similar Content

    • By Arulbabu Donbosco
      There are studios selling applications which is just copying any 3Dgraphic content and regenerating into another new window. especially for CAVE Virtual reality experience. so that the user opens REvite or CAD or any other 3D applications and opens a model. then when the user selects the rendered window the VR application copies the 3D model information from the OpenGL window. 
      I got the clue that the VR application replaces the windows opengl32.dll file. how this is possible ... how can we copy the 3d content from the current OpenGL window.
      anyone, please help me .. how to go further... to create an application like VR CAVE. 
       
      Thanks
    • By cebugdev
      hi all,

      i am trying to build an OpenGL 2D GUI system, (yeah yeah, i know i should not be re inventing the wheel, but this is for educational and some other purpose only),
      i have built GUI system before using 2D systems such as that of HTML/JS canvas, but in 2D system, i can directly match a mouse coordinates to the actual graphic coordinates with additional computation for screen size/ratio/scale ofcourse.
      now i want to port it to OpenGL, i know that to render a 2D object in OpenGL we specify coordiantes in Clip space or use the orthographic projection, now heres what i need help about.
      1. what is the right way of rendering the GUI? is it thru drawing in clip space or switching to ortho projection?
      2. from screen coordinates (top left is 0,0 nd bottom right is width height), how can i map the mouse coordinates to OpenGL 2D so that mouse events such as button click works? In consideration ofcourse to the current screen/size dimension.
      3. when let say if the screen size/dimension is different, how to handle this? in my previous javascript 2D engine using canvas, i just have my working coordinates and then just perform the bitblk or copying my working canvas to screen canvas and scale the mouse coordinates from there, in OpenGL how to work on a multiple screen sizes (more like an OpenGL ES question).
      lastly, if you guys know any books, resources, links or tutorials that handle or discuss this, i found one with marekknows opengl game engine website but its not free,
      Just let me know. Did not have any luck finding resource in google for writing our own OpenGL GUI framework.
      IF there are no any available online, just let me know, what things do i need to look into for OpenGL and i will study them one by one to make it work.
      thank you, and looking forward to positive replies.
    • By fllwr0491
      I have a few beginner questions about tesselation that I really have no clue.
      The opengl wiki doesn't seem to talk anything about the details.
       
      What is the relationship between TCS layout out and TES layout in?
      How does the tesselator know how control points are organized?
          e.g. If TES input requests triangles, but TCS can output N vertices.
             What happens in this case?
      In this article,
      http://www.informit.com/articles/article.aspx?p=2120983
      the isoline example TCS out=4, but TES in=isoline.
      And gl_TessCoord is only a single one.
      So which ones are the control points?
      How are tesselator building primitives?
    • By Orella
      I've been developing a 2D Engine using SFML + ImGui.
      Here you can see an image
      The editor is rendered using ImGui and the scene window is a sf::RenderTexture where I draw the GameObjects and then is converted to ImGui::Image to render it in the editor.
      Now I need to create a 3D Engine during this year in my Bachelor Degree but using SDL2 + ImGui and I want to recreate what I did with the 2D Engine. 
      I've managed to render the editor like I did in the 2D Engine using this example that comes with ImGui. 
      3D Editor preview
      But I don't know how to create an equivalent of sf::RenderTexture in SDL2, so I can draw the 3D scene there and convert it to ImGui::Image to show it in the editor.
      If you can provide code will be better. And if you want me to provide any specific code tell me.
      Thanks!
    • By Picpenguin
      Hi
      I'm new to learning OpenGL and still learning C. I'm using SDL2, glew, OpenGL 3.3, linmath and stb_image.
      I started following through learnopengl.com and got through it until I had to load models. The problem is, it uses Assimp for loading models. Assimp is C++ and uses things I don't want in my program (boost for example) and C support doesn't seem that good.
      Things like glVertexAttribPointer and shaders are still confusing to me, but I have to start somewhere right?
      I can't seem to find any good loading/rendering tutorials or source code that is simple to use and easy to understand.
      I have tried this for over a week by myself, searching for solutions but so far no luck. With tinyobjloader-c and project that uses it, FantasyGolfSimulator, I was able to actually load the model with plain color (always the same color no matter what I do) on screen and move it around, but cannot figure out how to use textures or use its multiple textures with it.
      I don't ask much: I just want to load models with textures in them, maybe have lights affect them (directional spotlight etc). Also, some models have multiple parts and multiple textures in them, how can I handle those?
      Are there solutions anywhere?
      Thank you for your time. Sorry if this is a bit confusing, English isn't my native language
  • Popular Now