Update README.md
Browse files
README.md
CHANGED
|
@@ -27,6 +27,9 @@ See [Weights and Biases](https://wandb.ai/ernlavr/adv_nlp2023/runs/t8icitt1) for
|
|
| 27 |
## Training procedure
|
| 28 |
- Input source document wrapped in a prompt: "Summarize the following article:\<INPUT\>; Summary: \<OUTPUT\>"
|
| 29 |
- Trained using cross-entropy on CausalLM task
|
|
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
### Training hyperparameters
|
| 32 |
|
|
|
|
| 27 |
## Training procedure
|
| 28 |
- Input source document wrapped in a prompt: "Summarize the following article:\<INPUT\>; Summary: \<OUTPUT\>"
|
| 29 |
- Trained using cross-entropy on CausalLM task
|
| 30 |
+
- Data splits consist of sequences up to 512 tokens:
|
| 31 |
+
- Training n-datapoints: 115'354 XSum; 27494 CNN
|
| 32 |
+
- Val n-datapoints: 3928 XSum; 1211 CNN
|
| 33 |
|
| 34 |
### Training hyperparameters
|
| 35 |
|