ajaxorg/ace — pull request #773 by nightwing (2012-05-24 18:14:38+00:00)
Title: improve bgTokenizer

-changes `getTokens(row, row)[0].tokens`; to `getTokens(row)`
-keeps lines and states in separate arrays (allows do drop lines array for background tabs as lines is the big one easy to generate on the fly and states is the important one slow to generate)
-keeps lines after unchanged state (typing one char won't discard whole token cache anymore)