Making the web site crawler visit each link only once