adding tokenizer for future use
various checks for newlines correctness, fixes #1
whitespace tests
bugs related to error location