Allow url overrides, also bring in spiderable properly.