Revert "Fix bug where topic wouldn't be visible if set by ChanServ"

This reverts commit 966949193b6be9d401268322cb3bb066dd2eb06d.