Terminating link graph traversal when encountering a URL for the second time.