Add uniqueness and time checking of crawling items