Don't remove duplicate deletion jobs

Change-Id: I1c67298572726ce842e7f86f03a129c1409a1f07