Update README.md
Browse files
README.md
CHANGED
|
@@ -25,7 +25,7 @@ pipeline_tag: text-generation
|
|
| 25 |
# Quark-50m-Instruct
|
| 26 |
|
| 27 |
**Quark-50m-Instruct** is a small (≈56M parameters) decoder-only language model, fine-tuned for instruction following.
|
| 28 |
-
It is built on the same architecture
|
| 29 |
[HuggingFaceTB/smollm‑corpus](https://huggingface.co/datasets/HuggingFaceTB/smollm-corpus).
|
| 30 |
|
| 31 |
- **Model type:** Causal Language Model (LLaMA‑style decoder)
|
|
|
|
| 25 |
# Quark-50m-Instruct
|
| 26 |
|
| 27 |
**Quark-50m-Instruct** is a small (≈56M parameters) decoder-only language model, fine-tuned for instruction following.
|
| 28 |
+
It is built on the same architecture of “SmolLM” family and was fully pretrained on 5 billion tokens from
|
| 29 |
[HuggingFaceTB/smollm‑corpus](https://huggingface.co/datasets/HuggingFaceTB/smollm-corpus).
|
| 30 |
|
| 31 |
- **Model type:** Causal Language Model (LLaMA‑style decoder)
|