Only die if the passphrase is incorrect.  Otherwise it's probably just a "wallet is already unlocked" error, which we can ignore.