tildeio/simple-html-tokenizer — pull request #15 by oneeman (2014-12-14 01:23:14+00:00)
Title: Move token methods to tokenizer

Prompted by suggestion in https://github.com/tildeio/htmlbars/pull/198. This just moves the methods and temporary state (`_currentAttribute`) to the tokenizer, so that tokens themselves contain just data. Still using constructors for them since the end-result is the same, plus the unit tests use the constructors for building expected values.

Reduces duplication a bit as some of the methods were identical or nearly so across several token types.