Tracking upstream latency separately

This PR attempts to retrieve the upstream latency from request->upstream_states in a very naive and potentially dangerous way.  Pushing this here due to our slightly stupid build process :-)
True... without unit tests I am extra paranoid though. I have a feeling (and a wish) that I'll have the time one of these days to re-do this module with proper unit tests :-)