Before revision:  Our experiments with such metrics show that probe's performance curves often fail to align with widely accepted rankings between language representations (with, e .g.,  non-contextual representations outperforming contextual ones).
After revision:  Our experiments with such metrics show that probe's performance curves often fail to align with widely accepted rankings between language representations (with, e .g., why should the non-contextual representations outperforming contextual ones).