Fix directory creation to not throw a warning on first run