Close notification when it's activated