Issue/2502 fixes unwanted horizontal lines in notifications

This PR is the same as #2540 (but mapped to `release/4.5`).

/cc @sendhil