sy
commited on
Commit
•
1770f07
1
Parent(s):
6057c56
Update README.md
Browse files
README.md
CHANGED
@@ -5,5 +5,5 @@ base_model: sysong11/dapt-kogpt
|
|
5 |
|
6 |
# Model Card for Model ID
|
7 |
|
8 |
-
The model is a pretrained
|
9 |
-
using unlabeled text
|
|
|
5 |
|
6 |
# Model Card for Model ID
|
7 |
|
8 |
+
The model is a pretrained revision of KoGPT6B-float16 on causal language modeling (CLM) objective, which was fitted
|
9 |
+
using unlabeled text from [a small supervised tuning dataset for summarization](https://huggingface.co/datasets/sysong11/sum_train_rev).
|