uniq post ids on crawl
Merge pull request #54 from tazima/bugfix-duplicate-posts

uniq post ids on crawl