Implemented tokenizer for C/C++ preprocessor