making http client more robust when upstream isnt available