It is now possible to control crawl concurrency and interval via the CLI.