Allow URLs to be excluded

Required feature otherwise the link checker can get stuck on pages which
have a huge number of self-referencing links (e.g. calendars).