Added Crawler configuration for the command line application