[BUGFIX] Also create Configuration dir for non-vagrant cases