Added foreign[@place='foot'] to set of ignored TEI when stripping.
Make the output for a gaiji without representation into a single token by enclosing the warning text in square brackets.
Modified asymmetric diff query to be much more performant.
Changed logging to use named loggers.
Added some logging when creating Text objects.
Use the correct logger when logging.
Changed Corpus.get_texts() to ignore directories, to work around OS X creating .DS_Store directories everywhere.
Added an example of a catalogue's contents.
Added search command for finding which texts contain how many of a set of n-grams. Closes #14.
Added documentation for tacl report's --extend option. Closes #15.
Added support for specifying an alternate tokenizer, namely one suitable for the Pagel Tibetan corpus documents. Closes #12.
Added and improved tests of alternate tokenizers, revealing unfinished work and bugs which are now fixed.
Added clarification of the (non-)behaviour of --extend on diff results. This is part of the fix for #16.
Changed label groups to sort based on total number of tokens rather than number of texts. Fixes #13.
Improved the tokenizer for the Pagel corpus, incorporating more of the punctuation characters used in the transliteration scheme.
Added test and code change for extending results from the Pagel corpus.
Added minimal debug logging for highlighting. Simplified XML serialisation.
Removed obsolete (and commented out) code.
Corrected logging calls.
Reworked extend to not use the Highlighter but instead a much faster approach. Adds the restriction that extend only works on result sets with >1-grams. Closes #17, though it is still too slow on really large results sets.