Optimize TessellateModifier.js slightly

`.distanceTo()` -> `distanceToSquared()`
Merge pull request #5824 from zz85/patch-1

Optimize TessellateModifier.js slightly