Replace main tokenizer scanner with buffer.

- Calling into the scanner (-scanLocation, -isAtEnd, -string,
  -characterAtIndex) imposed considerable overhead.