made tokenize available as separate object
implemented tokenizing lines