Spider for pulling down web links.