neuralmagic
/

llama-2-7b-chat-marlin

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

robertgshaw2 commited on Jan 18, 2024

Commit

ee20391

·

verified ·

1 Parent(s): c2e64dd

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ pip install -e .
 ### Convert Model
-The following converts the model from GPTQ to Marlin format. Note that this requires:
 - `sym=true`
 - `group_size=128`
 - `desc_activations=false`

 ### Convert Model
+Convert the model from GPTQ to Marlin format. Note that this requires:
 - `sym=true`
 - `group_size=128`
 - `desc_activations=false`