The error computed by Kodiak is shown in Line 8 and roughly corresponds to 3.23E −13. The generated valid range conditions can be used as implicit overflow detectors. In fact, if the value of an expression cannot be proven to be in the range, the lemma cannot be proven. This ...
The machine error resulting from this conversion is 1.77635683940025056328542382157e-16. As you can see in the fractional part of both formats, it's just "0011" repeating forever. Except it can't be forever on a finite machine. Presumably, you only care that it's say "6.55" when you com...
Part 1 Chapter 4 Roundoff and Truncation Errors PowerPoints organized by Dr. Michael R. Gustafson II, Duke University All images copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
The error computed by Kodiak is shown in Line 8 and roughly corresponds to 3.23E −13. The generated valid range conditions can be used as implicit overflow detectors. In fact, if the value of an expression cannot be proven to be in the range, the lemma cannot be proven. This ...