Only create the dir if it does not exist