|
|||||||||||
|
Technical Support On-Line Manuals Libraries and Floating Point Support Guide |
Libraries and Floating Point Support GuideIEEE 754 arithmetic and rounding
Arithmetic is generally performed by computing the result of an operation as if it were stored exactly (to infinite precision), and then rounding it to fit in the format. Apart from operations whose result already fits exactly into the format (such as adding 1.0 to 1.0), the correct answer is generally somewhere between two representable numbers in the format. The system then chooses one of these two numbers as the rounded result. It uses one of the following methods:
| ||||||||||
|
|||||||||||