Update README.md

README.md

@@ -1,31 +1,13 @@
 ---
 tags:
 - generated_from_trainer
-model-index:
-- name: kth256_shift1_640k_pythia-1.4b-lr1e-5
-  results: []
+- pythia
+license: apache-2.0
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
-
-# kth256_shift1_640k_pythia-1.4b-lr1e-5
-
-This model is a fine-tuned version of [/scr-ssd/cygu/weights/pythia-1.4b](https://huggingface.co//scr-ssd/cygu/weights/pythia-1.4b) on an unknown dataset.
-
 ## Model description
 
-More information needed
-
-## Intended uses & limitations
-
-More information needed
-
-## Training and evaluation data
-
-More information needed
-
-## Training procedure
+Sampling-based watermark distilled [Pythia 1.4B](https://huggingface.co/EleutherAI/pythia-1.4b) using the KTH \\(s=1\\) watermarking strategy in the paper [On the Learnability of Watermarks for Language Models](https://arxiv.org/abs/2312.04469).
 
 ### Training hyperparameters
 
@@ -40,13 +22,9 @@ The following hyperparameters were used during training:
 - lr_scheduler_warmup_steps: 500
 - num_epochs: 1.0
 
-### Training results
-
-
-
 ### Framework versions
 
 - Transformers 4.29.2
 - Pytorch 2.0.1+cu117
 - Datasets 2.13.1
-- Tokenizers 0.13.3
+- Tokenizers 0.13.3