Core/TrinityIrcChat: Solve issue with expired bans still being considered