[math] Fix performance problems with vector operations that relied a bit much on opIndex inlining.