added spiderVersion flag to set what version whould be spidered i.e. seperate from defaultVersion