Datetime of crawling and duplicate url's

Adding datetime of crawling and preventing duplicate url's on home_g1