bf16 vs fp32
❚❚ Pause
sign
exponent (8 bits)
mantissa
fp32
values per interval
8,388,608
bf16
values per interval
128
↑ same 8 exponent bits → same range
w