Fixed wrong returned flag
Improved the comments
Fixed the preprocessor
Fixed unupdated variables in the tokenizer