Fix handling of public key auth without a public key file