Make sure the backing interface no longer has an address