Added a tokenizer functionality
Fixed some issues with the fileTool - reading lines from files is now more robust.
Added a tokenizer functionality