shainaraza
commited on
Commit
•
d094ce3
1
Parent(s):
52ea78d
Update README.md
Browse files
README.md
CHANGED
@@ -7,6 +7,13 @@ This custom pipeline debiases toxic text using a toxicity classifier and GPT-2.
|
|
7 |
To use this pipeline, you first need to download the required models and tokenizers, and then import the `MyToxicityDebiaserPipeline` class:
|
8 |
|
9 |
```python
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
from transformers import AutoTokenizer, AutoModelForSequenceClassification, GPT2LMHeadModel, GPT2Tokenizer
|
11 |
from my_toxicity_debiaser import MyToxicityDebiaserPipeline
|
12 |
|
|
|
7 |
To use this pipeline, you first need to download the required models and tokenizers, and then import the `MyToxicityDebiaserPipeline` class:
|
8 |
|
9 |
```python
|
10 |
+
!git lfs install
|
11 |
+
!git clone https://huggingface.co/shainaraza/toxicity_debias_pipeline
|
12 |
+
|
13 |
+
%cd /toxicity_debias_pipeline
|
14 |
+
|
15 |
+
|
16 |
+
|
17 |
from transformers import AutoTokenizer, AutoModelForSequenceClassification, GPT2LMHeadModel, GPT2Tokenizer
|
18 |
from my_toxicity_debiaser import MyToxicityDebiaserPipeline
|
19 |
|