Document 2d6e832f4f8434cefbf14f1f708362fb6140fb17 in changelog. [ci skip]
Initial design of a simpler lexer implementation.
Refactor to make some functions unnecessary.
Simplify incremental lexer function.
Move latex specific stuff out of the base lexer implementation.
Update documentation.
Also test get_state and set_state.
Simplify incremental lexer implementation: do not use send/yield system.
Iterator fix, raise ValueError if function does not consume all tokens.