clear exceptions for removed agents (#493)

for some reason exceptions for primary owners were cleared correctly
without this change but not for secondary owners; this should take care
of both