Add crawler configuration in shell