Minor refactoring of the toknenization methods/tests.
Added tokenization of identifiers and keywords.
Added End Of Line comment support
Added tokenization of Integer values