Perfect calculation

Started by
2 comments, last by walkingcarcass 20 years, 10 months ago
A processor has a numerical innacuracy, sin(0)=0.0000254 and things like that. My calculator just told me (sin(pi/3))^2=0.75 how come it isn''t 0.7499989984 or something? It can give perfect answers to (log_e(2+(-1+e^arctan(1))))/pi and 1-10^-0.5 etc. How? ******** A Problem Worthy of Attack Proves It''s Worth by Fighting Back
spraff.net: don't laugh, I'm still just starting...
Advertisement
This isn''t really something for discussion really, is it? You need an article or a book to explain it to you.

Have you tried searching the web or your college library?
Depends on how many sig figs are used in the calculation and how many fixed decimal places you want.
Yeah. The calculator simply calculates at higher precision than it shows to you. Maybe it gets a result

sin(pi/3)^2 = 0.750000000000000000003457465

and then just shows you 0.75

Try doing something like

(0.15^500) ^ (1/500)

and you''ll likely get 0 instead of 0.15

This topic is closed to new replies.

Advertisement