crawler configuration