Removed probabilistic lexer, a general lexer is ok