Update README.md
Browse files
README.md
CHANGED
|
@@ -8,6 +8,9 @@ tags:
|
|
| 8 |
- opt
|
| 9 |
- peft
|
| 10 |
---
|
|
|
|
|
|
|
|
|
|
| 11 |
facebook/opt-2.7b finetuned with prefix tuning (https://arxiv.org/abs/2101.00190) with the FLAN datasets (https://arxiv.org/pdf/2210.11416.pdf).
|
| 12 |
|
| 13 |
24 token prefix finetuned over 3.7m new tokens of a FLAN task mixture.
|
|
|
|
| 8 |
- opt
|
| 9 |
- peft
|
| 10 |
---
|
| 11 |
+
|
| 12 |
+
## ptune-FLAN-OPT-2.7b
|
| 13 |
+
|
| 14 |
facebook/opt-2.7b finetuned with prefix tuning (https://arxiv.org/abs/2101.00190) with the FLAN datasets (https://arxiv.org/pdf/2210.11416.pdf).
|
| 15 |
|
| 16 |
24 token prefix finetuned over 3.7m new tokens of a FLAN task mixture.
|