Crawler finding href links and subdomain refs