Only clean up assets when they were extracted for use within a block.