Reload config correctly on change. Closes gh-540.