scrapinghub/webstruct — pull request #15 by chekunkov (2014-05-05 15:31:44+00:00)
Title: [WIP] Speed up text tokenizer

Trying to resolve issue #13

```
# now this takes ~3.2s to complete vs 5.2s for original version
X, y = HtmlTokenizer().tokenize(trees)
```