sileod commited on
Commit
f81f379
·
verified ·
1 Parent(s): ee7dc98

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -5,6 +5,5 @@ pipeline_tag: zero-shot-classification
5
 
6
  # Model Card for Model ID
7
 
8
- Continuous fine-tuning of deberta-tasksource, fine-tuned on newer tasksource and with context length of size 1024.
9
-
10
- Upcoming: longer training + 1280 tokens context length.
 
5
 
6
  # Model Card for Model ID
7
 
8
+ deberta-v3-base with context length of 1280 fine-tuned on tasksource for 150k steps. I oversampled tasks like ConTRoL, doc-nli.
9
+ Training data include helpsteer v1/v2, logical reasoning tasks (FOLIO, FOL-nli, LogicNLI...), OASST, hh/rlhf, linguistics oriented NLI tasks, tasksource-dpo, fact verification tasks.