|
--- |
|
license: mit |
|
datasets: |
|
- stereoset |
|
- crows_pairs |
|
language: |
|
- en |
|
metrics: |
|
- f1 |
|
- recall |
|
- precision |
|
- accuracy |
|
--- |
|
|
|
# Sentence-Level Multidimensional Bias Classifier |
|
|
|
The Sentence-Level Bias Classifier is a transformer-based model developed to detect and classify different types of biases present in text at the sentence level. It is designed to recognize stereotypical and anti-stereotypical biases towards gender, race, profession, and religion. The model can help in developing applications aimed at mitigating biased language use and promoting fairness and inclusivity in natural language processing tasks. |
|
|
|
## Model Architecture |
|
|
|
The model is built using the `distilbert-base-uncased` pretrained model, a smaller and faster version of BERT. It is fine-tuned on a custom dataset for the task of sentence-level bias classification. The model uses a Sentence Classification architecture, typically used for Text Classification tasks. |
|
|
|
## Model Performance |
|
|
|
| Metric | Value | |
|
|------------------------|-------------------------| |
|
| eval_loss | 0.49603304266929626 | |
|
| eval_precision | 0.7144313872416078 | |
|
| eval_recall | 0.7034186400261718 | |
|
| eval_f1 | 0.6980022981890632 | |
|
| eval_balanced accuracy | 0.7034186400261718 | |
|
| eval_runtime | 177.7807 | |
|
| eval_samples_per_second| 59.348 | |
|
| eval_steps_per_second | 3.712 | |
|
| epoch | 6.0 | |
|
|
|
## Classes |
|
|
|
The model identifies nine classes, including: |
|
|
|
0. unrelated: The token does not indicate any bias. |
|
1. stereotype_gender: The token indicates a gender stereotype. |
|
2. anti-stereotype_gender: The token indicates an anti-gender stereotype. |
|
3. stereotype_race: The token indicates a racial stereotype. |
|
4. anti-stereotype_race: The token indicates an anti-racial stereotype. |
|
5. stereotype_profession: The token indicates a professional stereotype. |
|
6. anti-stereotype_profession: The token indicates an anti-professional stereotype. |
|
7. stereotype_religion: The token indicates a religious stereotype. |
|
8. anti-stereotype_religion: The token indicates an anti-religious stereotype. |
|
|
|
## Usage |
|
|
|
The model can be used as a part of the Hugging Face's pipeline for Text Classification. |
|
|
|
```python |
|
from transformers import pipeline |
|
|
|
nlp = pipeline("text-classification", model="wu981526092/Sentence-Level-Multidimensional-Bias-Detector", tokenizer="wu981526092/Sentence-Level-Multidimensional-Bias-Detector") |
|
result = nlp("Text containing potential bias...") |
|
|
|
print(result) |
|
``` |
|
|
|
## Performance |
|
|
|
The performance of the model can vary depending on the specifics of the text being analyzed. It's recommended to evaluate the model on your specific task and text data to ensure it meets your requirements. |
|
|
|
## Limitations and Bias |
|
|
|
While the model is designed to detect bias, it may not be perfect in its detections due to the complexities and subtleties of language. Biases detected by the model do not represent endorsement of these biases. The model may also misclassify some tokens due to the limitation of BERT's WordPiece tokenization approach. |
