Task: Question Generation
Input (English): We define a metric called the Semantic Text Exchange Score (STES) that evaluates the overall ability of a model to perform STE, and an adjustable parameter masking (replacement) rate threshold (MRT/RRT) that can be used to control the amount of semantic change.
Output (English): Has STES been previously used in the literature to evaluate similar tasks?