Full example from fetchbot repo
Set crawl delay to 0
When following redirects, add destination to dup

This doesn't happen for the seed URL, yet
Parse relative URLs based on post-redirect URL
Make critical region narrower in enqueueLinks()
Remove stale TODO comment

No need to worry about mutex here