Allow forced yubikey only if yubikey data is set