Restructure ExecConfig policy reload, add unit tests

Close #1885