fbaldassarri
/

HuggingFaceTB_SmolLM2-1.7B-auto_gptq-int4-gs128-asym

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

fbaldassarri commited on 1 day ago

Commit

7bce049

•

1 Parent(s): c4dd12f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -39,7 +39,7 @@ Quantized version of [HuggingFaceTB/SmolLM2-1.7B](HuggingFaceTB/SmolLM2-1.7B) us
 Quantization framework: [Intel AutoRound](https://github.com/intel/auto-round) v0.4.3
-Note: this INT4 version of SmolLM2-360M-Instruct has been quantized to run inference through CPU.
 ## Replication Recipe

 Quantization framework: [Intel AutoRound](https://github.com/intel/auto-round) v0.4.3
+Note: this INT4 version of SmolLM2-1.7B has been quantized to run inference through CPU.
 ## Replication Recipe