Floating point issue
. I have created a volume texture from a set of slices of USHORT values.
. The data in these slices had values from 0 to 65535.
. I wrote a shader program which can get a particular pixel from the volume texture.
. When the value of the pixel exceeds 2048 it does not give the right value.
. I came across a site:- http://www.3dcenter.org/artikel/nv40_technik/index3_e.php
where they said about a precision problem when the value goes above 2048.
. I am using 7800 GTX card. Will my card also have the same problem?
. What should I do to regain from this trouble.
[Edited by - manur on November 8, 2006 3:21:55 AM]
This topic is closed to new replies.
Advertisement
Popular Topics
Advertisement