Hackerpilot/Dscanner — pull request #11 by roman-d-boiko (2012-04-28 16:37:10+00:00)
Title: Introduced token annotations

This is proposed design, please review before pulling.
One of possible alternatives is to introduce tokens for each combination of string literal kind and string width, but token annotations are useful for several purposes (token validity, character literal types, etc.).