More planning and research.
Write basic tokenizer cli.
Wow, actually works.
Detect globals.
Fix global wraparound.
Add mode.
Write temp files.
Update chunk size.
Optimize cli a little bit.
Create bin and scripts directories.
Fix a bug where strings were matched.
Add rollover font lock optimization.
Fix off-by-one error.
Only color changed regions.
Use asynchronous command execution strategy.
Enable font lock again.
Use idle timers instead of font lock.
Vastly improve idle timer strategy.
Minor tweaks.
Some progress, probably have to switch back to lexical.