Do not blithely accept keys unless specified in ssh config