Update README.md
Browse files
README.md
CHANGED
@@ -73,8 +73,7 @@ The model was trained on Vietnamese Oscar dataset (32 GB) to optimize a traditio
|
|
73 |
|
74 |
### GPT-2 Finetuning
|
75 |
|
76 |
-
The following example fine-tunes GPT-2 on WikiText-2. We're using the raw WikiText-2
|
77 |
-
the tokenization). The loss here is that of causal language modeling.
|
78 |
|
79 |
The script [here](https://github.com/huggingface/transformers/blob/main/examples/pytorch/language-modeling/run_clm.py) .
|
80 |
|
|
|
73 |
|
74 |
### GPT-2 Finetuning
|
75 |
|
76 |
+
The following example fine-tunes GPT-2 on WikiText-2. We're using the raw WikiText-2.
|
|
|
77 |
|
78 |
The script [here](https://github.com/huggingface/transformers/blob/main/examples/pytorch/language-modeling/run_clm.py) .
|
79 |
|