remove memories for pruned data (for memory efficiency)