added crawler as script and rate limiting + config