Support storing cache paths relative to a base path
Support a fallback directory for cache entries

This is only used for reading directory entries