Prevent sending one final notification clear after disabling the setting