MiniLLM
/

KD-gpt2-120M

Text Generation

Model card Files Files and versions Community

t1101675 commited on 3 days ago

Commit

663364f

•

1 Parent(s): 5dd0744

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ pipeline_tag: text-generation
 **KD-gpt2-120M** is a gpt2-base (120M) model distilled from [gpt2-xlarge (1.5B)](https://huggingface.co/MiniLLM/teacher-gpt2-1.5B) on [databricks-dolly-15k](https://huggingface.co/datasets/aisquared/databricks-dolly-15k) with token-level forward KLD.
-It is used as a baseline for [MiniLLM](MiniLLM/MiniLLM-gpt2-120M).
 ## Other Baselines

 **KD-gpt2-120M** is a gpt2-base (120M) model distilled from [gpt2-xlarge (1.5B)](https://huggingface.co/MiniLLM/teacher-gpt2-1.5B) on [databricks-dolly-15k](https://huggingface.co/datasets/aisquared/databricks-dolly-15k) with token-level forward KLD.
+It is used as a baseline for [MiniLLM](https://huggingface.co/MiniLLM/MiniLLM-gpt2-120M).
 ## Other Baselines