Simplified logic in RoundRobinTokenizer.