already processed links are not processed again