tokenizer and stemming function in hitchhiker.py