Oskar van der Wal commited on
Commit
e03dc2a
1 Parent(s): b2e49d6

Update notice.md

Browse files
Files changed (1) hide show
  1. notice.md +6 -3
notice.md CHANGED
@@ -1,3 +1,6 @@
1
- # AI still stupid
2
-
3
- don't get fooled; it's all just numbers
 
 
 
 
1
+ # Measuring bias in language models is hard!
2
+ How to measure bias in language models is not trivial and still an active area of research.
3
+ First of all, what is bias? As you may have noticed, stereotypes may change across languages and cultures.
4
+ What is problematic in the USA, may not be relevant in the Netherlands---each cultural context requires its own careful evaluation.
5
+ Furthermore, defining good ways to measure it is also difficult.
6
+ For example, [Blodgett et al. (2021)](https://aclanthology.org/2021.acl-long.81/) find that typos, nonsensical examples, and other mistakes threatens the validity of CrowS-Pairs.