Improve cookbook entry for error pages in 2.3+

This PR cherry-picks the improvements from #4293 that apply to 2.3 as well (almost all!).

It also addresses some of the considerations in #4181. 
your configuration, we should not refer to a specific format