Enhanced rule and link extractor for Scrapy CrawlSpider