more fixes. trying to fix spiders to
spider multiple urls from same ip...