replace empty strings with nil while tokenizing
add an option to remove newlines
add fast stemmer
add postings list
change tokenizer to just be a processing pipeline
app now creates a dictionary