Tracking upstream latency separately

This PR attempts to retrieve the upstream latency from request->upstream_states in a very naive and potentially dangerous way.  Pushing this here due to our slightly stupid build process :-)