Yes, of course! Even if someone blocks you in a channel, you can stay. Messages or content sent in that channel won't be immediately viewable (like any other user).