Added lex tokenizer with some tests.

Signed-off-by: matematik7 <domen.ipavec@z-v.si>