Create ctrlp's cache directory