Change _identifyTokens to write to an internal array of "new tokens"

I've cleaned up some of the tokenizing code, removing unused vars etc. The biggest change is the lack of `array_merge` for `$newTokens`. This seems to have a major speed increase.