Error yaml file

Branched off of `error-config-file` to avoid merge conflicts, might want to merge `error-config-file` first.

Fixes #4