Removed the use of a dynamic buffer for tokenizing preprocessor.