Minor address space code simplification.

Remove assertion that the verifier should catch.