Remove channel from chan list upon getting kicked.