Add private ModifiedConfiguration class

- Doesn't load config file when constructed
- Doesn't create config file on load if it doesn't exist