Complex sentence: A token rule is used to recognize a token lexeme that is a variable character sequence that is kept.
Split into simpler sentences: A token rule is used to recognize a token lexeme. It is a variable character sequence that is kept.