Some notification fixes

https://www.pivotaltracker.com/story/show/65449324