add function of removing similary url
Merge branch 'add_unqi_url' of git://github.com/jetz/second-spider into jetz-add_unqi_url

Conflicts:
	utils.py
merge uniq rule filter function from jetz