Right now we just crash, since configuration is only loaded at startup time.

In the long run, it would be nice to propagate these errors all the way back to whoever loads the config. With rule parsing, it was like this before, but I implemented the error propagation later on (when users were able to input expressiosn during runtime). For the config, this still needs to happen.