I noticed that `modelMatrix` is not actually past to `BoxGeometry`, but to `GeometryInstance`, so never mind.  My bad.