Converted CrawlConfig to a case class implemented DRY.