Altova Mailing List Archives>Archive Index >microsoft.public.xml Archive Home >Recent entries >Thread Prev - Mathematical accuracy in xpath >Thread Next - Re: Mathematical accuracy in xpath Re: Mathematical accuracy in xpathTo: NULL Date: 6/16/2009 3:15:00 PM kinobo wrote: > If I execute the following xslt I get the result given below. > I'm no mathematician but 100 times 2500.01 does not equal 250001.00000000003 Well XPath 1.0 uses double floating point numbers like JavaScript or Java do too and with these there is limited precision, in particular when there is no finite binary representation of a number. With XSLT 1.0 you can use format-number to ensure you get a certain number of decimal positions. Or you need to change to XPath 2.0 (as implemented by Saxon 9) and use xs:decimal numbers instead of double numbers. -- Martin Honnen --- MVP XML http://msmvps.com/blogs/martin_honnen/ | ||||||
| Company | Legal | Press | Partners | Careers | Sitemap | Contact Us | Altova Blog | Mobile | Full Site | |||
|
