Handle broken X-Forwarded-For case.

When the remote address is invalid in some way, ignore and assume
it's a public address.