Altova Mailing List Archives>Archive Index >microsoft.public.xml Archive Home >Recent entries >Thread Prev - Re: Mathematical accuracy in xpath [Thread Next] Re: Mathematical accuracy in xpathTo: NULL Date: 6/16/2009 7:21:00 AM Thanks Martin for your speedy any useful reply. "Martin Honnen" wrote: > kinobo wrote: > > If I execute the following xslt I get the result given below. > > I'm no mathematician but 100 times 2500.01 does not equal 250001.00000000003 > > > > Well XPath 1.0 uses double floating point numbers like JavaScript or > Java do too and with these there is limited precision, in particular > when there is no finite binary representation of a number. > > With XSLT 1.0 you can use format-number to ensure you get a certain > number of decimal positions. Or you need to change to XPath 2.0 (as > implemented by Saxon 9) and use xs:decimal numbers instead of double > numbers. > > -- > > Martin Honnen --- MVP XML > http://msmvps.com/blogs/martin_honnen/ > | ||||||
| Company | Legal | Press | Partners | Careers | Sitemap | Contact Us | Altova Blog | Mobile | Full Site | |||
|
