Clear notifications where necessary, and not during clear_cache