Update requirements
Remove url required of CLI
Add logger
Add logger to downloader
Add cleardb option to CLI
Add license notice to logger
Fix max-depth query in SameDomainSelector
Fix bug in SameDomainSelector again
Decrease waiting time in CLI
Add regular expression support to SameDomainSelector
Cleanup config.rb
Add TODO to news_crawler.rb
Change test config (make domain more general)
Cleanup default_sds.yml (default config for SameDomainSelector)
Add NCLogger test
remove need of method_missing in url queue