Add configuration directory with sentinel file.