Floating Point/Rounding: Difference between revisions
Jump to navigation
Jump to search
imported>PokestarFan |
(No difference)
|
Latest revision as of 02:57, 15 June 2017
Rounding
IEEE 754 specified four distinct rounding modes. We will talk about those modes, and their effects in this chapter. Also, rounding can play an important role in the accuracy of a floating-point computation, so we will discuss those effects here as well.
Rounding Modes
Rounding Errors
Relative Error
Relative error is one measure of error commonly used with floating point numbers. If is an approximation to , then the relative error, , is defined as