Starting to use tokenstreams.  added tokenizeline to tokenizer