It's definitely worth adding a comment along the lines of "the content is wiki markup which gets converted to `<p>blah</p>` which gets tokenized as `['p', 'blah']`".

Also, I vaguely remember a bug about removing html from the content before indexing. Erik said there might be a tokenizer that does that. Is that something you've seen while working on this? If not, no biggie. I think there's a bug for it somewhere.