Sign in to follow this  

Floating point issue

Recommended Posts

. I have created a volume texture from a set of slices of USHORT values. . The data in these slices had values from 0 to 65535. . I wrote a shader program which can get a particular pixel from the volume texture. . When the value of the pixel exceeds 2048 it does not give the right value. . I came across a site:- where they said about a precision problem when the value goes above 2048. . I am using 7800 GTX card. Will my card also have the same problem? . What should I do to regain from this trouble. [Edited by - manur on November 8, 2006 3:21:55 AM]

Share this post

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Sign in to follow this