Fix error caches responses for without vary headers

I think we can remove the body from these requests if we're not asserting anything with them.