Fix glitch of recrawling duplicate links on page