Merged from trunk
Absorb parser work from parser-ng
Merged from trunk
Merged from trunk
Merged characterset branch
Fix tokenizer's Makefile.am
Merged from upstream
Convert Tokenizer::token to rely on other Tokenizer methods
Removed redundant comment
Add optional limit parameter to Tokenizer::prefix()
Update documentation
Polish namespace usage in .cc
Fix file include order and paths
Docs: formalize Tokenizer uniform method behaviour
Fix Tokenizer::token
Interim: start implementing Parser::Tokenizer::int64
Implement Parser::Tokenizer::int64 and unit tests
Clarify Parser::Tokenizer::int64 documentation, add one test case.
Merged from trunk
Unit test for sub-string parsing