Use cache and in-progress per server. Fix 304 case with memory cache.