add config for crawling