switched over to non-deprecated http client jar.
lie about user agent so juxta requests dont get rejected as forbidden.
send more helpful status message back to caller on http erros