TempFile::sweep shouldn't free smart allocated objects