Tokenizer works with all hyphen and capital letter combinations, very messy though
tokenizer splits on all combinations of required characters
tokenizer now adds any email adress as a token wihthin a line
Tokenizer stems with PorterStemmer before adding but code of tokenizer is very messy!