Improved the error reporting of failing to lex or parse.
Corrected the normalisation of some contraction rules.
Cleaned up the interface between Ragel and the Tokenizer class.
Refactoring and cleaning up some of the integration between the SGML
lexer and tokenizer.
Updated the SGMLish lexer to properly die when it fails to consume any
input, and to let it account for malformed unescaped ampersands.
Added new versions of the ragel-generated source code.