Make sure incremental dir exists