Makes sure that done moderation queues stay marked done

Fixes #1425