updated version and added duplicate detection
updated to include seed urls and duplicate content detection
updated version and readme