Updated lexer rules management with yielding unit tests

Signed-off-by: Grégory PLANCHAT <g.planchat@gmail.com>