Explain regex/index optimization more thoroughly

I did some code review and talked to Hari and Richard to confirm this.  The same explanation also holds for 2.6.