Finally track notifications sent, so we don't repeat