SivilTaram
commited on
Commit
•
ee4c0b7
1
Parent(s):
93d6909
Update README.md
Browse files
README.md
CHANGED
@@ -8,10 +8,6 @@ license: mit
|
|
8 |
|
9 |
TAPEX Zero is a novel approach for instruction tuning that leverages synthetic tasks to improve the performance of language models on unseen tasks. The proposed approach utilizes symbolic tasks for instruction tuning, which has demonstrated its effectiveness in enhancing the performance of language models on unseen tasks, as exemplified by the case study on zero-shot table reasoning.
|
10 |
|
11 |
-
## Intended uses
|
12 |
-
|
13 |
-
TAPEX Zero can be used for fine-tuning language models on tasks with instructions, especially when there is limited labeled data available. It can also be used for zero-shot learning, where the model can generalize to unseen tasks without any labeled data.
|
14 |
-
|
15 |
## Training data
|
16 |
|
17 |
The model is trained on a variety of datasets that include symbolic tasks such as SQL queries. The training data also includes generic datasets to ensure that the model maintains its original performance on those datasets.
|
@@ -22,4 +18,4 @@ As with any machine learning model, TAPEX Zero may have limitations and biases b
|
|
22 |
|
23 |
## Code base
|
24 |
|
25 |
-
The code used to train TAPEX Zero is available at https://github.com/
|
|
|
8 |
|
9 |
TAPEX Zero is a novel approach for instruction tuning that leverages synthetic tasks to improve the performance of language models on unseen tasks. The proposed approach utilizes symbolic tasks for instruction tuning, which has demonstrated its effectiveness in enhancing the performance of language models on unseen tasks, as exemplified by the case study on zero-shot table reasoning.
|
10 |
|
|
|
|
|
|
|
|
|
11 |
## Training data
|
12 |
|
13 |
The model is trained on a variety of datasets that include symbolic tasks such as SQL queries. The training data also includes generic datasets to ensure that the model maintains its original performance on those datasets.
|
|
|
18 |
|
19 |
## Code base
|
20 |
|
21 |
+
The code used to train TAPEX Zero is available at https://github.com/sail-sg/symbolic-instruction-tuning
|