Remove unique app urls checking in parse function since Scrapy already has built-in duplicate request filter.