robrix/Hammer — pull request #46 by robrix (2014-04-03 07:21:05+00:00)
Title: [WIP] Lexers

Taking a stab at incremental lexers.

- [ ] reify tokens
- [ ] tokens have source information
- [ ] produce tokens for a grammar incrementally

- Fixes #25.
- cf #10.
- cf#14.