remove sleep() in spider since we can use DOWNLOAD_DELAY option in settings