Gotta break eggs to make an omelette...minimal port of lexer source so I can start re-introducing offset info
Put some bernaise sauce on that omelette...
Bye position factory and rough in on offset-based lexer source
move towards tokens for bundling positions when lexing tokens are created
Remove errant printf. Add default char instead of explicit check
errors should not propagate out and on_parse_error should happen
Allow ripper to know about __END__
Make beginning of percent tokens return themselves as tokens + whitespace
double quote token
Weird token off-by-one issue which I don't get.  Just moving to end to stop beating my head against the wall
Add token for backref token types
End of string types should be matching the front and not just "
: tSYMBEG token added
Moar tokens
Moar ';'
dot tokens added
NPE fixed when comment is EOF
Missed first whitespace char on on_sp + errant getPosition() to fix the location
A few moar places fixed
All missing tokens? moarest