Ensure tmp/cache exists