remove duplicate check url
add kankan crawl