Before revision:  Our experiments with such metrics show that probe's performance curves often fail to align with widely accepted rankings between language representations (with, e .g.,  non-contextual representations outperforming contextual ones).
After revision:  Our experiments using Pareto hypervolume as an evaluation metric show that probes often do not conform to our expectations---e .g., non-contextual representations outperforming contextual ones).