Don't initialize voxel map too early