added --url-ttl parameter to command line to control re-crawl behavior