Allow paramiko to do key type checking