KAFKA-1001; Handle follower transition in batch; patched by Guozhang Wang; reviewed by Jun Rao