Add gitignore
Use scrapy default User-Agent
Ignore TellAFriend. Unignore PDFs, etc.
Canonicalise URLs to lowercase
www.hmrc.gov.uk and hmrc.gov.uk are the same
Sort start URLs
Fix title extraction