text billions of segments of text and in the end you use the internal representation learned by the network as input we to a downstream supervised task like you know natural language inference parsing winogradsky all kinds of stuff and this meets the record on just about it you know although the benchmarks in the glue so glue is in super glue our set of benchmarks in natural language understanding and systems based on bird the latest one is Roberta from Facebook actually has the record I think a few days ago Microsoft came up with an