Updated crawler to not use config.json.