Turn off a channel you're trying to leave