Ah yeah, this line shuffles the extracted links
```
        urlstext = set([(clean_url(url).encode(response_encoding), clean_text(text))
                        for url, _, text in links_text])
```