DRY and generally reduce code in scanPunctuator function.

Performance impact is negligible.

https://code.google.com/p/esprima/issues/detail?id=370
Add a minimal documentation on the tokenizer API.

https://code.google.com/p/esprima/issues/detail?id=398
Merge branch 'master' into gh-pages