Added tmp/ dir (not exactly tmp/ as it holds some files used for testing)
Moved some files to tmp/
Stylistic change in docs
TokenStream supports indexing
Some improvements in lexer
First tests
Added Makefile
In docs: default strategy changed name to simple
Minor refactoring in lexer
Small fix in tests
New tests
Minor refactoring
Updated lexer frontend
Added CLAP UI for lexer, must be now invoked in 'lex' mode
Implemented 'drop' error-handling strategy
Whitespace is now consumed by dedicated function
Fixed function naming
Refactored some code to _consumeInvalid() method
Invalid sequences are consumed without following whitespace
Invalid sequences are consumed wihtout following string