AntoineBlanot commited on
Commit
9f6bb5d
1 Parent(s): 08aa6a0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -5
README.md CHANGED
@@ -126,12 +126,17 @@ Benefits and Drawbacks:
126
  - (**-**) Looses text-to-text ability
127
 
128
  ## Results
129
- Results on the validation data of training tasks:
130
  | Dataset | Accuracy | F1 |
131
  |:-------:|:--------:|:--:|
132
- | MNLI (m)| 1 | 0.905 |
133
- | MNLI (mm) | 0.900 |0.900 |
134
- | SNLI | 0.900 |0.900 |
135
- | SciTail | 0.900 |0.900 |
 
 
 
 
 
136
 
137
  Special thanks to [philschmid](https://huggingface.co/philschmid) for making a Flan-T5-xxl [checkpoint](https://huggingface.co/philschmid/flan-t5-xxl-sharded-fp16) in fp16.
 
126
  - (**-**) Looses text-to-text ability
127
 
128
  ## Results
129
+ Results on the validation data of **training tasks**:
130
  | Dataset | Accuracy | F1 |
131
  |:-------:|:--------:|:--:|
132
+ | MNLI (m)| 0.923 | 0.923 |
133
+ | MNLI (mm) | 0.922 | 0.922 |
134
+ | SNLI | 0.942 | 0.942 |
135
+ | SciTail | 0.966 | 0.647 |
136
+
137
+ Results on validation data of **unseen tasks** (zero-shot):
138
+ | Dataset | Accuracy | F1 |
139
+ |:-------:|:--------:|:--:|
140
+ | ?| ? | ? |
141
 
142
  Special thanks to [philschmid](https://huggingface.co/philschmid) for making a Flan-T5-xxl [checkpoint](https://huggingface.co/philschmid/flan-t5-xxl-sharded-fp16) in fp16.