Fix for stupid opinion modifier issue

(And caught another bug where the main referee event wasn't properly
clearing flags before reassignment)