Merge pull request #11 from kali/master

Conditions and configurable token enum.
no more need feature(globs)
demonstrate lexer property
doc refresh
Fix a test.
The question mark is now usable as a token to denote optionality instead of the percent sign.