Fixed CrawlCommand's handling of duplicate entries, changed style and formatting of console output