Don't abort() if client connection failed in server

Just give a warning.