Fix config initialization

- Properly load non-default config files
- Avoid bombing when there is nothing to exclude