modified spiders to accept custom patterns fro date