Built basic structure of LexicalProcessor.
Gradually implementing LexicalProcessor. Should convert to state machine...
Done implementation of line breaks, whitespaces, comments. Need to finish token and preprocessor directives.
Added regular expression support.
No need to change state if the method is already returning.
Updated project file.