Revert "Fix problem with mutes/bans/etc?"

This reverts commit 4a29d18e5ee798bc3da140fb5de59b2ca19418e7.