VoxelManipulator: Remove unnecessary deallocation steps