Make sure the whisper dir is set as well

Without this carbon cache just throws permission errrors