Refine new CLI summary

Builds on #12365

* Rewrote some of the language
* Turned off by default
* Added `cli_summary` config option
* Added `--summary` CLI switch