If the address is already adjusted don't readjust it.