Added the spider_file option, allowing the ability to specify the spider file that should be used. This allows for per site / config spider files