diversifix commited on
Commit
aaf38ac
1 Parent(s): 99bfb23

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -24
README.md CHANGED
@@ -4,7 +4,7 @@ language:
4
  license: gpl
5
  ---
6
 
7
- # Diversiformer
8
 
9
  _Work in progress._
10
 
@@ -31,31 +31,11 @@ Source code for fine-tuning is available [on GitHub](https://github.com/diversif
31
  ## Usage
32
 
33
  ```python
34
- from transformers import T5Tokenizer, TFT5ForConditionalGeneration
35
-
36
- tokenizer = T5Tokenizer.from_pretrained("diversifix/diversiformer")
37
- model = TFT5ForConditionalGeneration.from_pretrained("diversifix/diversiformer")
38
-
39
- def generate(prompt, tokenizer, model):
40
- tokenized_text = tokenizer.encode(prompt, return_tensors="tf")
41
- ids = model.generate(tokenized_text, max_length=500)
42
- output = tokenizer.decode(ids[0], skip_special_tokens=True)
43
- return output
44
-
45
- prompts = [
46
- 'Ersetze "Schüler" durch "Schülerin oder Schüler": Die Schüler kamen zu spät.',
47
- 'Ersetze "Lehrer" durch "Kollegium": Die wartenden Lehrer wunderten sich.',
48
- ]
49
-
50
- for prompt in prompts:
51
- output = generate(prompt, tokenizer, model)
52
- print(f"{prompt}\n{output}\n\n")
53
  ```
54
 
55
- ## Dev ideas
56
-
57
- - Use classifier to filter out training data of low quality? (~adversarial approach)
58
-
59
  ## License
60
 
61
  Diversiformer. Transformer model for inclusive language.
 
4
  license: gpl
5
  ---
6
 
7
+ # Diversiformer 🤗 🏳️‍🌈 🇩🇪
8
 
9
  _Work in progress._
10
 
 
31
  ## Usage
32
 
33
  ```python
34
+ >>> from transformers import pipeline
35
+ >>> generator = pipeline("text2text-generation", model="diversifix/diversiformer")
36
+ >>> generator('Ersetze "Schüler" durch "Schülerin oder Schüler": Die Schüler kamen zu spät.', max_length=500)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
37
  ```
38
 
 
 
 
 
39
  ## License
40
 
41
  Diversiformer. Transformer model for inclusive language.