[Poshuku] Keep all caches in cache dir.

Fixes #1816.