Task: Question Generation
Input (English): We measure how contextual a word representation is using three different metrics: self-similarity, intra-sentence similarity, and maximum explainable variance.
Output (English): What experiments are proposed to test that upper layers produce context-specific embeddings?