date and id fixes
timestamp
mongo indices to be used with setup script
throttle spiders
schedule spiders using celery