more bug fixes. if spiders disabled for row
in url filters, don't spider the url.