Skip to content
hpcnotes
Loading…
HPC·Arithmetic
2026.09.11· 1 min

Integer Numbers

Wrapping, widening, and the multiply that becomes a shift. Know the width.
Fast Inverse Square Root........................................................................................................................................................................................................Previous
Integer Division........................................................................................................................................................................................................Next
#hpc
Floating-Point Numbers........................................................................................................................................................................................................2026.09.11
IEEE 754 Floats........................................................................................................................................................................................................2026.09.11
Rounding Errors........................................................................................................................................................................................................2026.09.11
Newton's Method........................................................................................................................................................................................................2026.09.11
Fast Inverse Square Root........................................................................................................................................................................................................2026.09.11
Suggest an editMarkdownHistory