Modified if statement to prevent duplicates falling through.
Merge branch 'queue-exists' of https://github.com/Cordazar/node-simplecrawler into queue-exists