added some comments in tokenixer files