Before revision:  We design a strategy for measuring the significanceof the word-vectors based on the self-attention mechanism of the encoders which helps us identify the word-vectors to be eliminated.
After revision:  We design a strategy for measuring their significance, based on the self-attention mechanism of the encoders which helps us identify the word-vectors to be eliminated.