Update README.md
Browse filesTop-10 attention heads causing gender bias have been identified using DiffMask+, as proposed in the paper "Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language Model." The model was fine-tuned using the Balanced BUG dataset (Levy et al., 2021).
README.md
CHANGED
@@ -8,4 +8,6 @@ tags:
|
|
8 |
- fine-tune
|
9 |
- gpt2
|
10 |
- llm
|
11 |
-
---
|
|
|
|
|
|
8 |
- fine-tune
|
9 |
- gpt2
|
10 |
- llm
|
11 |
+
---
|
12 |
+
|
13 |
+
Top-10 attention heads causing gender bias have been identified using DiffMask+, as proposed in the paper "Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language Model." The model was fine-tuned using the Balanced BUG dataset (Levy et al., 2021).
|