add tokenizer.c testing