string tokenizer written in C. was written for homework at Rutgers University