suayptalha
/

Komodo-Llama-3.2-3B

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

suayptalha commited on Nov 20, 2024

Commit

c055ea7

·

verified ·

1 Parent(s): 59c00d9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -17,7 +17,7 @@ metrics:
 This version of Komodo is a Llama-3.2-3B-Instruct finetuned model on lighteval/MATH-Hard dataset to increase math performance of the base model.
-This model is 4bit-quantizated. You should import it 8bit if you want to use 3B parameters!
 Make sure you installed 'bitsandbytes' library before import.
 Example Usage:

 This version of Komodo is a Llama-3.2-3B-Instruct finetuned model on lighteval/MATH-Hard dataset to increase math performance of the base model.
+This model is 4bit-quantized. You should import it 8bit if you want to use 3B parameters!
 Make sure you installed 'bitsandbytes' library before import.
 Example Usage: