Fixes to multiplying dialogs
Added tests for tokenizers
New improved tokenizer