Ensure that configs exist before editing on Red Hat systems