Before revision:  In support of our arguments, the results of this illustrative experiment conform closer to accepted rankings among contextual word representations.
After revision:  In support of our suggestion that harder probing tasks are necessary, our experiments with dependency parsing reveal a wide gap in syntactic knowledge between contextual and non-contextual representations.