Do not fail unreferenced object cleanup on invalid object in history