1.9: switch to hack_encoding instead of trying utf-8 first. Fixed a number of false positives
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7882]
+ Optimized regexp used for identifiers. (presidentbeef)
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7893]
+ Added RBStringScanner#string_to_pos using String#byteslice.
       + Added RBStringScanner#charpos using #string_to_pos.
       - Fixed current_line and unread_many depending on StringScanner#pos

       Why the fuck is StringScanner#pos byte-oriented in 1.9?!? That makes NO sense.

       This brings me up to 99.967% success rate against 558k files, bringing me 3.6σ. Rawr.

[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7894]
prepped for release
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7895]
+ Lexing regexps w/ bad character encodings and no declared options will fall back to /n

[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7903]
Minor cleanup
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7904]
- 1.9.2 doesn't have String#byteslice... so I have to do the *HORRIBLE*.

[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7916]
prepped for release
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7917]
+ Only output parseerror output to stderr if $DEBUG.
- Fixed RubyParser#process to reuse parser instances across calls.
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7933]
+ Minor optimization to RubyLexer#parse_number
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7934]
+ Added RP_TIMEOUT env var to override default timeout of 10 seconds.
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7935]
Oops. Broke the tests with the error output changes.

[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7936]
- 1.9: Fixed lexing stabby lambda w/ do/end
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7961]
- 1.9: Fixed args in dot-call forms (eg f.(...)).
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7963]
Minor enhancements to my debug and bugs tasks
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7970]
+ ruby_parse_extract_error modified to include 'it' blocks in its search.
- Fixed line numbers for several productions.
- Deal better with DOS files. Ugh.
- Fix line number of production after heredoc.
- new_call sets line number to smallest line number of members.

[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7971]
minor fix for previous int lexing optimization
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7984]
sort the dirs files before parsing them, for my sanity
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7985]
prepped for release
[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7987]
- Fixed lexing of no-name ivars. (whitequark)
+ Improved error output on invalid char in expression.

[git-p4: depot-paths = "//src/ruby_parser/dev/": change = 7989]