Before revision:  We propose a model-agnostic toolkit LAUG to approximate natural perturbation for testing the robustness issues in dialog systems .
After revision:  We propose a model-agnostic toolkit LAUG to approximate natural language perturbations for testing the robustness issues in dialog systems .