parser for Wikipedia article dumps
extract links from WP dumps
sample of nlwiki dump, for testing
test link extraction, fix "[[anchor]]s" links
detect redirects
tests for wikidump parsing
clean text extraction

Todo: handle external links
extract only WP pages in main namespace (assuming it's always 0)
dump parser: test [[crazy]][[link]]s

Spotted by @IsaacHaze.
add remove_links to, well, remove links
dump parser: function to gather all statistics from one page
full Wiki-dump parser operational

Needs a better tokenizer.
move WP dump parser into semanticizest package
bug in dump parser's redirect handling

Strengthened tests by adding a redirect.
return strings from n-grams

We need strings anyway, and this is slightly faster (and easier to
optimize in Cython).
make counting n-grams optional when processing WP dump

N-gram counting is the most expensive part of this, and is not
required for baseline entity linking.
add Travis-CI config
Merge pull request #3 from semanticize/travis-ci

Add parser for WP database dumps