avoid stopping searching if link was already downloaded for some
searches