bugfix in alise
ensure tokens are in a persistentvector
added support for including dictionary terms in config file
consolidated tokenisation for nmd generation
io and trie tests migrated to midje