Actually use the address right

The old method would translate to each one going in a different byte if
addr was incremented, instead of going up the stack in each byte.