Jump to content

  • Log In with Google      Sign In   
  • Create Account

DX11 - Volume Rendering - Article Misunderstanding


Old topic!
Guest, the last post of this topic is over 60 days old and at this point you may not reply in this topic. If you wish to continue this conversation start a new topic.

  • You cannot reply to this topic
23 replies to this topic

#1 Migi0027   Crossbones+   -  Reputation: 2137

Like
1Likes
Like

Posted 06 September 2013 - 07:52 AM

Hi guys! Again... ohmy.png

 

So I'm trying to follow an article/tutorial on volume rendering from GraphicsRunner (Great!) [ http://graphicsrunner.blogspot.dk/2009/01/volume-rendering-101.html ].

 

But there is something which I don't understand, which is the following:

 

 

 

We could always calculate the intersection of the ray from the eye to the current pixel position with the cube by performing a ray-cube intersection in the shader. But a better and faster way to do this is to render the positions of the front and back facing triangles of the cube to textures. This easily gives us the starting and end positions of the ray, and in the shader we simply sample the textures to find the sampling ray.

 

So I understand that I have to render the back and front culled positions to individual textures, which I am doing and it works (It looks fine), but does he mean render the depth model into view + projected space, or to render it as a texture that can be sampled onto the cube with the cubes respective texture coordinates?

 

Thanks, as always.

-MIGI0027


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

Sponsor:

#2 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 06 September 2013 - 01:03 PM

And if it is the 2nd case, how would I be able to accomplish it? huh.png


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#3 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 06 September 2013 - 01:32 PM

Just to confirm something, the back and front textures look the same to me, comparing mine with:

 

http://graphicsrunner.blogspot.dk/2009/01/volume-rendering-101.html (Scroll a bit down).


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#4 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 06 September 2013 - 03:17 PM

One step further, the re-projection is working correctly... 

 

It's amazing how far I am from the original question. tongue.png


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#5 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 06 September 2013 - 03:24 PM

If anyone has had the same problem, for the love of god, what did I do wrong? (Still testing)

 

2dkh6ae.png


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#6 Jason Z   Crossbones+   -  Reputation: 5446

Like
0Likes
Like

Posted 06 September 2013 - 03:29 PM

I read that post a while back, and what he is doing is storing the end points of a segment that would be created by passing a ray through the volume, and then using those end points to do the ray marching through the volume.  So what you need to do is look at his comparison function and figure out how he performs the iterative step.

 

In my volume rendering implementation in Hieroglyph 3, I use the texture space coordinates and step through the texture that way.  If you wanted to do that, you would find the 3D texture coordinate at the pixel location for the front and back faces, and store them accordingly.  Then you can simply step from the front value to the back value and do a texture lookup at each step, looking for the intersection with the isosurface.



#7 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 06 September 2013 - 03:36 PM

Still testing and changing.

 

If useful, here is the shader:

cbuffer ConstantObjectBuffer : register (b0)
{
	matrix worldMatrix;

	float3 StepSize;
	float Iterations;

	float4 ScaleFactor;
};

#define Side 2

cbuffer ConstantFrameBuffer : register (b1)
{
	
	matrix viewMatrix;
	matrix projectionMatrix;

	float3 eyepos;
	float cppad;

	float4 lightvec;
	float4 lightcol;

	float FogStart;
	float FogEnd;
	float2 __space;

	float3 FogColor;
	float shadows;

	float SpecularIntensity;
	float3 pad3;
	float4 SpecularColor;
}

//***************************************************//
//                 VERTEX SHADER                     //
//***************************************************//

struct VOut
{
    float4 position : SV_POSITION;
    float3 texC		: TEXCOORD0;
    float4 pos		: TEXCOORD1;
    float2 texcoord : TEXCOORD2;
    float3 normal   : NORM;
};

struct GlobalIn
{
	float4 position : POSITION;
	float4 normal : NORMAL;
	float2 texcoord : TEXCOORD;
	float4 tangent : TANGENT;
};
	
**CE_RESERVED_SHADER[INPUTS]**

Texture3D t_VolData : register(t0);
Texture2D t_TransFront : register(t1);
Texture2D t_TransBack : register(t2);

SamplerState ss;

VOut VShader(GlobalIn input)
{
    VOut output;

    input.position.w = 1.0f;
	output.texcoord = input.texcoord;

	// Calculate the position of the vertex against the world, view, and projection matrices.
    output.position = mul(input.position, worldMatrix);
    output.position = mul(output.position, viewMatrix);
    output.position = mul(output.position, projectionMatrix);

	output.texC = input.position;
    output.pos = output.position;
    output.normal = mul(float4(input.normal.xyz,0), worldMatrix);
	
    return output;
}

//***************************************************//
//                 PIXEL SHADER                      //
//***************************************************//

struct POut
{
	float4 Diffuse  : SV_Target0;
	float4 Position : SV_Target1;
	float4 Depth    : SV_Target2;
	float4 Normals  : SV_Target3;
	float4 Lighting : SV_Target4;
};

// Functions
float4 GetVRaycast(VOut input)
{
	//calculate projective texture coordinates
    //used to project the front and back position textures onto the cube
    float2 texC = input.pos.xy /= input.pos.w;
	texC.x =  0.5f*texC.x + 0.5f; 
	texC.y = -0.5f*texC.y + 0.5f;  
 
    float3 front = t_TransFront.Sample(ss, texC).xyz;
    float3 back = t_TransBack.Sample(ss, texC).xyz;
 
    float3 dir = normalize(back - front);
    float4 pos = float4(front, 0);
 
    float4 dst = float4(0, 0, 0, 0);
    float4 src = 0;
 
    float value = 0;
 
    float3 Step = dir * StepSize;
 
    for(int i = 0; i < 32; i++)
    {
        pos.w = 0;
        value = t_VolData.Sample(ss, pos).r;
             
        src = (float4)value;
        src.a *= .5f; //reduce the alpha to have a more transparent result 
         
        //Front to back blending
        // dst.rgb = dst.rgb + (1 - dst.a) * src.a * src.rgb
        // dst.a   = dst.a   + (1 - dst.a) * src.a     
        src.rgb *= src.a;
        dst = (1.0f - dst.a)*src + dst;     
     
        //break from the loop when alpha gets high enough
        if(dst.a >= .95f)
            break; 
     
        //advance the current position
        pos.xyz += Step;
     
        //break if the position is greater than <1, 1, 1>
        if(pos.x > 1.0f || pos.y > 1.0f || pos.z > 1.0f)
            break;
    }
 
    return dst;
}

POut PShader(VOut input)
{
	POut output;

	// Depth
	output.Depth = float4(0, 0, 0, 1.0f);

	// Normals
	output.Normals = float4(normalize(input.normal), 1);
	output.Position = float4(0, 0, 0, 1);
	output.Lighting = float4(1, 1, 1, 1);

	output.Diffuse = GetVRaycast(input);

	return output;
}

Thanks!

-MIGI0027


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#8 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 07 September 2013 - 01:31 AM

Still on my epic quest!

 

Btw, found this awesome paper on volume rendering (only needed the part about 3d textures), http://vplab.snu.ac.kr/lectures/11-1/comp_appl/05_Texture_Based_Volume_Rendering_Lab.pdf


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#9 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 07 September 2013 - 01:37 AM

What is going on? huh.png

 

2ezojdj.png


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#10 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 07 September 2013 - 06:15 AM

Can somebody confirm that this is an Ok way of loading a volume texture:

// Will be filled and returned
	ID3D11ShaderResourceView* pSRV = NULL;
 
	// Build the texture header descriptor
	D3D11_TEXTURE3D_DESC descTex;
	descTex.Width = width;
	descTex.Height = height;
	descTex.Depth = depth;
	descTex.Format = DXGI_FORMAT_R8G8B8A8_UNORM;
	descTex.Usage = D3D11_USAGE_DEFAULT;
	descTex.BindFlags = D3D11_BIND_SHADER_RESOURCE | D3D11_BIND_RENDER_TARGET;
	descTex.CPUAccessFlags = 0;
	descTex.MipLevels = 1;
	descTex.MiscFlags = D3D10_RESOURCE_MISC_GENERATE_MIPS;

	// Load Data into Memory
	const int size = height*width*depth;

	// Initialize memory
    unsigned int* pVolume = new unsigned int[size];

	// Load into memory
	FILE* pFile = fopen ( (const char*)filePath.c_str() , (const char*)"rb" );
	fread(pVolume,sizeof(unsigned int), size, pFile);
    fclose(pFile);
 
	// Resource data descriptor, with depth
	D3D11_SUBRESOURCE_DATA data ;
	data.pSysMem = pVolume;
	data.SysMemPitch = 1.0f * width;
	data.SysMemSlicePitch = width * height * 1;

	/*_until(r, depth)
	{
		// Fetch Data

		memset( &data[r], 0, sizeof(D3D11_SUBRESOURCE_DATA));
		data[r].pSysMem = pData;
		data[r].SysMemPitch = 4 * width;
	}*/
 
	// Create the 3d texture from data
	ID3D11Texture3D * pTexture = NULL;
	HV( pDevice->CreateTexture3D( &descTex, &data, &pTexture ));
 
	// Create resource view descriptor
	D3D11_SHADER_RESOURCE_VIEW_DESC srvDesc;
	srvDesc.Format = descTex.Format;
	srvDesc.ViewDimension = D3D11_SRV_DIMENSION_TEXTURE3D;

	srvDesc.Texture3D.MostDetailedMip = 0;
	srvDesc.Texture3D.MipLevels = D3D11_RESOURCE_MISC_GENERATE_MIPS;

	// Create the shader resource view
	HV( pDevice->CreateShaderResourceView( pTexture, &srvDesc, &pSRV ));
 
	return pSRV;

Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#11 unbird   Crossbones+   -  Reputation: 6023

Like
0Likes
Like

Posted 07 September 2013 - 06:31 AM

One thing: Your pitches are wrong. For RGBA8 a texel is 4 bytes in size, so
data.SysMemPitch = width * 4;
data.SysMemSlicePitch = width * height * 4;
And the pitches are uints, not floats (the compiler likely warns you here).

I'm probably sounding like a broken record now but I recommend using PIX/graphics debugger to see if resources are loaded/initialized fine.

PS: Oh, and thanks for the first link. That's quite a resourceful site. And it's mostly C# biggrin.png

#12 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 07 September 2013 - 09:19 AM

Still kinda wierd, but thanks, still trying though.

 

i751tx.png


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#13 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 07 September 2013 - 09:38 AM

Ok, so I'm just going to post all the code in case that I did something stupid as usual. tongue.png

 

Back, Front map rendering:

cbuffer ConstantObjectBuffer : register (b0)
{
	matrix worldMatrix;

	float pad_f;
	float instance;
	float2 pad_v2;
};

cbuffer ConstantFrameBuffer : register (b1)
{
	matrix viewMatrix;
	matrix projectionMatrix;
};


struct VOut
{
    float4 position : SV_POSITION;
    float3 texC		: TEXCOORD0;
    float4 pos		: TEXCOORD1;
};

Texture2D t_alphamap : register(t0);
Texture2D t_dffalpha : register(t1);
SamplerState ss;

VOut VShader(float4 position : POSITION, float4 normal : NORMAL, float2 texcoord : TEXCOORD, float3 instancePosition : INSTANCEPOS)
{
    VOut output;

	if (instance == 1)
	{
		position.x += instancePosition.x;
		position.y += instancePosition.y;
		position.z += instancePosition.z;
	}

    position.w = 1.0f;
	position = position * float4(1, 1, 1, 1);

	// Calculate the position of the vertex against the world, view, and projection matrices.
    output.position = mul(position, worldMatrix);
    output.position = mul(output.position, viewMatrix);
    output.position = mul(output.position, projectionMatrix);

	output.texC = position;
    output.pos = output.position;

    return output;
}

float4 PShader(VOut input) : SV_TARGET
{
	return float4(input.texC, 1.0f);
}

Code for volume rendering:

//*******CONFIGURE OBJECT BUFFER
	bff_PrObject.worldMatrix = world;
	bff_PrObject.Iterations = 24;

	//*******CALCULATE PROPERTIES

	float mStepScale = 1.0f;

	float maxSize = (float)max(volume->m_pVolumeData.m_Width, max(volume->m_pVolumeData.m_Height, volume->m_pVolumeData.m_Depth));
	bff_PrObject.StepSize = D3DXVECTOR3(1.0f / volume->m_pVolumeData.m_Width, 1.0f / volume->m_pVolumeData.m_Height, 1.0f / volume->m_pVolumeData.m_Depth);
	bff_PrObject.Iterations = (int)maxSize * (1.0f / mStepScale);

	D3DXVECTOR3 sizes = D3DXVECTOR3(volume->m_pVolumeData.m_Width, volume->m_pVolumeData.m_Height, volume->m_pVolumeData.m_Depth);
	D3DXVECTOR3 ratios = D3DXVECTOR3(1, 1, 1);

	D3DXVECTOR3 r(sizes.x * ratios.x, sizes.y * ratios.y, sizes.z * ratios.z);
	
	D3DXVECTOR3 c1 = (D3DXVECTOR3(1, 1, 1) * maxSize);
	D3DXVECTOR3 d(c1.x / r.x, c1.y / r.y, c1.z / r.z);

	bff_PrObject.ScaleFactor = D3DXVECTOR4( 1.0f / d.x, 1.0f / d.y, 1.0f / d.z, 1.0f );

	//*******SMART SEND ALL BUFFERS
	devcon->UpdateSubresource(pCBuffer[0], 0, 0, &bff_PrObject, NULL, NULL);
	devcon->UpdateSubresource(pCBuffer[1], 0, 0, &bff_PrFrame, NULL, NULL);

	devcon->VSSetConstantBuffers(0, 2, pCBuffer);
	devcon->PSSetConstantBuffers(0, 2, pCBuffer);

	//*******SEND RESOURCES
	ID3D11ShaderResourceView 
		*front = volume->transHolder.m_pFront.GetShaderResourceView(), 
		*back = volume->transHolder.m_pBack.GetShaderResourceView();

	devcon->PSSetShaderResources(0, 1, &volume->m_pVolumeData.pTexture);
	devcon->PSSetShaderResources(1, 1, &front);
	devcon->PSSetShaderResources(2, 1, &back);

	FOREACH (volume->Parameters.Parameters.size())
	{
		devcon->PSSetShaderResources(volume->Parameters.Parameters[i].slot, 1, &volume->Parameters.Parameters[i].resource);
	}

	//*******PREPARE PASS
	Pass.Prepare(devcon, rastManager);

	devcon->DrawIndexed(bf.IndexCount, 0, 0);

	//*******CLEAN UP
	ID3D11ShaderResourceView *n = NULL;
	FOREACH (volume->Parameters.Parameters.size())
	{
		devcon->PSSetShaderResources(volume->Parameters.Parameters[i].slot, 1, &n);
	}
	
	devcon->PSSetShaderResources(0, 1, &n);
	devcon->DSSetShaderResources(1, 1, &n);
	devcon->DSSetShaderResources(2, 1, &n);

Shader code for volume:

cbuffer ConstantObjectBuffer : register (b0)
{
	matrix worldMatrix;

	float3 StepSize;
	float Iterations;

	float4 ScaleFactor;
};

#define Side 2

cbuffer ConstantFrameBuffer : register (b1)
{
	
	matrix viewMatrix;
	matrix projectionMatrix;

	float3 eyepos;
	float cppad;

	float4 lightvec;
	float4 lightcol;

	float FogStart;
	float FogEnd;
	float2 __space;

	float3 FogColor;
	float shadows;

	float SpecularIntensity;
	float3 pad3;
	float4 SpecularColor;
}

//***************************************************//
//                 VERTEX SHADER                     //
//***************************************************//

struct VOut
{
    float4 position : SV_POSITION;
	float3 texC		: TEXCOORD0;
    float4 pos		: TEXCOORD1;
	float2 texcoord : TEXCOORD2;
	float3 normal   : NORM;

	**CE_RESERVED_SHADER[LINKAGE]**
};

struct GlobalIn
{
	float4 position : POSITION;
	float4 normal : NORMAL;
	float2 texcoord : TEXCOORD;
	float4 tangent : TANGENT;
};
	
**CE_RESERVED_SHADER[INPUTS]**

Texture3D t_VolData : register(t0);
Texture2D t_TransFront : register(t1);
Texture2D t_TransBack : register(t2);

sampler3D VolumeS = sampler_state
{
	Texture = <t_VolData>;
	MinFilter = LINEAR;
	MagFilter = LINEAR;
	MipFilter = LINEAR;
	
	AddressU = Border;				// border sampling in U
    AddressV = Border;				// border sampling in V
    AddressW = Border;
    BorderColor = float4(0,0,0,0);	// outside of border should be black
};

SamplerState ss;

VOut VShader(GlobalIn input)
{
    VOut output;

    input.position.w = 1.0f;
	output.texcoord = input.texcoord;

	**CE_RESERVED_SHADER[PREVERTEX]**

	// Calculate the position of the vertex against the world, view, and projection matrices.
    output.position = mul(input.position, worldMatrix);
    output.position = mul(output.position, viewMatrix);
    output.position = mul(output.position, projectionMatrix);

	output.texC = input.position;
    output.pos = output.position;
    output.normal = mul(float4(input.normal.xyz,0), worldMatrix);

	**CE_RESERVED_SHADER[VERTEX]**
	
    return output;
}

//***************************************************//
//                 PIXEL SHADER                      //
//***************************************************//

struct POut
{
	float4 Diffuse  : SV_Target0;
	float4 Position : SV_Target1;
	float4 Depth    : SV_Target2;
	float4 Normals  : SV_Target3;
	float4 Lighting : SV_Target4;
};

// Functions
float4 GetVRaycast(VOut input)
{
	//calculate projective texture coordinates
    //used to project the front and back position textures onto the cube
    float2 texC = input.pos.xy /= input.pos.w;
	texC.x =  0.5f*texC.x + 0.5f; 
	texC.y = -0.5f*texC.y + 0.5f;  
 
    float3 front = t_TransFront.Sample(ss, texC).xyz;
    float3 back = t_TransBack.Sample(ss, texC).xyz;
 
    float3 dir = normalize(back - front);
    float4 pos = float4(front, 0);
 
    float4 dst = float4(0, 0, 0, 0);
    float4 src = 0;
 
    float value = 0;
 
    float3 Step = dir * StepSize;
 
    for(int i = 0; i < 32; i++)
    {
        pos.w = 0;
        value = t_VolData.Sample(ss, pos).r;
             
        src = (float4)value;
        src.a *= .5f; //reduce the alpha to have a more transparent result 
         
        //Front to back blending
        // dst.rgb = dst.rgb + (1 - dst.a) * src.a * src.rgb
        // dst.a   = dst.a   + (1 - dst.a) * src.a     
        src.rgb *= src.a;
        dst = (1.0f - dst.a)*src + dst;     
     
        //break from the loop when alpha gets high enough
        if(dst.a >= .95f)
            break; 
     
        //advance the current position
        pos.xyz += Step;
     
        //break if the position is greater than <1, 1, 1>
        if(pos.x > 1.0f || pos.y > 1.0f || pos.z > 1.0f)
            break;
    }
 
    return dst;
}

POut PShader(VOut input)
{
	POut output;

	// Depth
	output.Depth = float4(0, 0, 0, 1.0f);

	// Normals
	output.Normals = float4(normalize(input.normal), 1);
	output.Position = float4(0, 0, 0, 1);
	output.Lighting = float4(1, 1, 1, 1);

	**CE_RESERVED_SHADER[PIXEL]**

	output.Diffuse = GetVRaycast(input);

	return output;
}

PS. Don't mind the weird things like **CE...


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#14 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 08 September 2013 - 01:36 AM

These are the ray directions produced:

 

e87ib7.png

qss2yx.png

2vvt0uw.png

23j0gux.png

 

I don't think that looks quite right.


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#15 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 08 September 2013 - 02:08 AM

Direction rays, again:

 

124egc5.png


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#16 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 08 September 2013 - 02:44 AM

I usually don't work with for loops in shaders, but this one requires so.

 

But when I don't use a constant in the loop max, then the compilation takes hell of a while, hasn't compiled yet, so I stopped the program.

So changing to this:

for(int i = 0; i < Iterations; i++)

Why is that so?

 

EDIT: Well the compiler is trying to unroll an infinite loop, so it fails...

-MIGI0027


Edited by Migi0027, 08 September 2013 - 04:12 AM.

Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#17 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 08 September 2013 - 04:27 AM

Alright, fixed that issue, but it's still not quite right.

 

2a0axyd.png


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#18 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 08 September 2013 - 08:30 AM

Much better now.

 

2u7sms0.png

 

PS. Can somebody confirm that this isn't totally wrong (if that's a question)


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#19 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 08 September 2013 - 08:40 AM

Nah stuff is still wrong, the reason for the foot to look better is because I cheated a bit:

for(int i = 0; i < Iterations; i++)
    {
        pos.w = 0;
        value = t_VolData.SampleLevel(ss, pos/4.1f, 1).r; // See that /4.1f, that the naughty stuff

It is supposed to look like this:

 

foot_thumb%5B11%5D.png?imgmax=800

 

 

Any help on this while I battle on?

-MIGI0027


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!

#20 Migi0027   Crossbones+   -  Reputation: 2137

Like
0Likes
Like

Posted 08 September 2013 - 08:59 AM

I see that the repeating pattern dissapears when scaling the vertices (3rd party program), to 1/4th of the original size. But then the resolution is terrible.


Hi! Cuboid Zone
The Rule: Be polite, be professional, but have a plan to steal all their shaders!




Old topic!
Guest, the last post of this topic is over 60 days old and at this point you may not reply in this topic. If you wish to continue this conversation start a new topic.



PARTNERS