elvircrn
/

Llama-2-7b-SPQR-3Bit-16x16-red_pajama-hf

Model card Files Files and versions Community

elvircrn commited on Dec 2, 2024

Commit

06746d8

·

verified ·

1 Parent(s): 38440d3

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -29,7 +29,7 @@
         "beta1": 16,
         "beta2": 16,
         "bits": 3,
-        "linear_weights_not_to_quantize": [
             "model.embed_tokens.weight",
             "model.layers.0.input_layernorm.weight",
             "model.layers.0.post_attention_layernorm.weight",

         "beta1": 16,
         "beta2": 16,
         "bits": 3,
+        "modules_to_not_convert": [
             "model.embed_tokens.weight",
             "model.layers.0.input_layernorm.weight",
             "model.layers.0.post_attention_layernorm.weight",