Added ability for tokenizer to track lines read for reporting better errors to the user.