Roll up more than 3 notifications into 1 [ci skip]