Should always do the mkdir even if not doing rm