Correctly initialize directories required for fetch or build