File size: 729 Bytes
a80ec68
bcf374e
 
 
4cd84ad
6b413da
92443e2
 
 
1
2
3
4
5
6
7
8
9
10
### Results for French and English language models
BERT is another popular type of language model, and CrowS-Pairs has originally been designed for BERT instead of GPT-2.
Here you can find the results for two languages, English and French, from the authors of [the extended version of CrowS-Pairs](https://aclanthology.org/2022.acl-long.583.pdf):

> "Bias evaluation on the enriched CrowS-pairs corpus, after collection of new sentences in French, translation to create a bilingual corpus, revision and filtering. A score of 50 indicates an absence of bias. **Higher scores indicate stronger preference for biased sentences.**"

![](https://github.com/clclab/contrastive-pairs-demo/raw/main/aggregated_results_crows-pairs.PNG)