In some cases we don't need to updateWorldVertices.