Close the notification whatever happens