Skip to content
hpcnotes
Loading…
HPC·Arithmetic
2026.09.11· 1 min

IEEE 754 Floats

NaN, denormals, and FTZ. Denormals in the hot path are a performance bug.
Floating-Point Numbers........................................................................................................................................................................................................Previous
Rounding Errors........................................................................................................................................................................................................Next
#hpc
Floating-Point Numbers........................................................................................................................................................................................................2026.09.11
Rounding Errors........................................................................................................................................................................................................2026.09.11
Newton's Method........................................................................................................................................................................................................2026.09.11
Fast Inverse Square Root........................................................................................................................................................................................................2026.09.11
Integer Numbers........................................................................................................................................................................................................2026.09.11
Suggest an editMarkdownHistory