Lex and evaluate characters.