Top-10 attention heads causing gender bias have been identified using DiffMask+, as proposed in the paper "Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language Model." The model was fine-tuned using the Balanced BUG dataset (Levy et al., 2021).
- Downloads last month
- 24
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.