New analyzer and test cases

A new analyser, tokeniser, and a set of test cases.