Removed unused var.
Refactored identifierToken to use keywordTokens map.
Parameterize tokenizer functions on chunk.
Pulled tokenizer list out into an array.
Extracted 'tokenise' function from exports.tokenize.
Merge pull request #188 from puffnfresh/lexer-refactor

Lexer refactor