pre-cache style checking setting used heavily in loop
~3% performance boost
optimise checking for fall-through comment
~3% performance boost
Save constructing temporary strings when adding tokens
~10% performance boost
Optimise frequently executed math helpers
~1% performance boost
Cache filetype for tokenizing
~10% performance boost
Optimise testing for comments
~1% performance boost
save found enum value for later reuse
~2% performance boost
Cache executable scode to save stack dereferences
~1% performance boost
make evaluation lazy
allow compiler to better unroll loop
~2% performance boost
Reduce amount of branching
~3% performance boost