FYI, fixing it as recommended by @dangra (change from `set` to `scrapy.utils.python.unique` in order to grab the first link)
https://github.com/redapple/scrapy/commit/73ae6b850b11e8a6525138698fbe0c179fa983ff