Web Inspector: update javascriptsourcetokenizer to produce "whitespaces" token
https://bugs.webkit.org/show_bug.cgi?id=108945

Patch by Andrey Lushnikov <lushnikov@chromium.org> on 2013-02-06
Reviewed by Pavel Feldman.

Source/WebCore:

Update re2c grammar for SourceJavaScriptTokenizer to produce
"whitespace" token which holds consequtive whitespaces in it.

Updated existing tests expectations.

* inspector/front-end/DOMSyntaxHighlighter.js:
(WebInspector.DOMSyntaxHighlighter.prototype.createSpan): Do not strip spaces from tokens with class "whitespaces".
* inspector/front-end/SourceJavaScriptTokenizer.js: Regenerated.
(WebInspector.SourceJavaScriptTokenizer.prototype.nextToken):
* inspector/front-end/SourceJavaScriptTokenizer.re2js:

LayoutTests:

Update test expectations so that they have "whitespace" token in
there.

* inspector/editor/highlighter-basics-expected.txt:
* inspector/editor/highlighter-chunk-limit-expected.txt:
* inspector/editor/highlighter-long-line.html:
* inspector/editor/text-editor-long-line-expected.txt:
* inspector/syntax-highlight-html-expected.txt:
* inspector/syntax-highlight-javascript-expected.txt:

git-svn-id: http://svn.webkit.org/repository/webkit/trunk@141987 268f45cc-cd09-0410-ab3c-d52691b4dbfc