The problem with lost precision

3 (bf16: 8) 0.05
More controls
start point

Each step, Adam nudges every weight by about the learning rate. If the nudge doesn't get a weight halfway to the next grid value, it rounds back.