Fix issue when removing notifcations