Only override the SSH host/user/etc if not specified by provider