Changed frontier scrapy integration from middlewares to scheduler