Added N-gram shingle analysis and stop words removal to standard
tokenizer