Remove bad assertion and skip missing UIDs instead.

Similar to the KeyError issue, if UIDs disappear in the middle of a flag
update operation, we just shouldn't update them.

Fixes T153.