mozilla/rust — pull request #14630 by cmr (2014-06-03 19:55:38+00:00)
Title: A bunch of lexer changes

These are a pain to rebase, so I'm separating this from the rest of my work.
Nothing controversial here, just some simple refactoring and removal of an
unused entry in the token table. Brings the lexer into 2012 with methods!