Memory pool management for voxel extensions