check duplicate in the output of crab jobs