Do not re-add an addresses

When an address was re-added it would clear out the utxos which would
cause a full re-sync