Tag: floating-point
Interview Questions
- Why summing 0.1 ten times misses 1.0, and how to fix it
- Storing money in floats is a bug waiting to reconcile
- The value that is not equal to itself: handling NaN
- When the textbook variance formula returns a negative number
- Why 0.1 + 0.2 != 0.3, and how to compare floats
- When Kahan summation still fails, and Neumaier's fix
- Variance of huge, nearly equal numbers, why the textbook formula blows up
- Pairwise summation, the trick NumPy uses for nearly free accuracy
- A settlement total that is off by a penny, and why floats caused it
- Kahan summation, adding a million small numbers