Attempt to make the InMemoryResponseCacher more performant

* This prevents http responses from re-parsing the body, etc.