Hugging Face's logo

HuangRT
/
AWQ_quant_cache

Model card Files
xet
Community
HuangRT commited on
Commit
a6dde06
·
verified ·
1 Parent(s): 54e94b2

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. Llama-3.1-8B-Instruct-w4-g128-awq-v2.pt +3 -0
  2. Llama-3.1-Minitron-4B-Width-Base-w4-g64-awq-v2.pt +3 -0
  3. llama-2-7b-chat-w4-g128-awq-v2.pt +3 -0
  4. llama3.1_8b_llm_pruner-bl-0.25-finetuned-w4-g64-v2.pt +3 -0
  5. llama3.1_8b_llm_pruner-bl-0.5-finetuned-w4-g64-v2.pt +3 -0
  6. llama3.1_8b_llm_pruner-bl-0.625-finetuned-w4-g64-v2.pt +3 -0
  7. llama3.1_8b_llm_pruner-w4-g128-awq-v2.pt +3 -0
  8. llama3.1_8b_wanda_24_nsamples128-w4-g128-awq-v2.pt +3 -0
Llama-3.1-8B-Instruct-w4-g128-awq-v2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26432cb45a476032eaf9d2ab1c5a4b26b5a5898e5cab1ecaaad43703fa8df682
3
+ size 5809926711
Llama-3.1-Minitron-4B-Width-Base-w4-g64-awq-v2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06615bd13a8bc64e8a1a3c98978490a3e447383b2e5800cb6cae93c0ce977e8c
3
+ size 3671751389
llama-2-7b-chat-w4-g128-awq-v2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9cf07cff3f0506def343e0407253ced806096c7b5cb6e18814d18ad5be80695a
3
+ size 3966524653
llama3.1_8b_llm_pruner-bl-0.25-finetuned-w4-g64-v2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f468f5b46741c7b783c39cba3e86227b2e56fc3e8f3945d1ff0296d31e837a5
3
+ size 5234004009
llama3.1_8b_llm_pruner-bl-0.5-finetuned-w4-g64-v2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8201263056eaba94c299174875f022a82c7564d9972449bcc42d3e223bd2743
3
+ size 4433153346
llama3.1_8b_llm_pruner-bl-0.625-finetuned-w4-g64-v2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a11f466ee3765598116fabfc346ceda5e4428efc274418d45a3797efee43900a
3
+ size 3966603616
llama3.1_8b_llm_pruner-w4-g128-awq-v2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6bb3fc381c754c8187eca4354cecd2cedfaea662036917da82c12d22d705cfd5
3
+ size 5058488878
llama3.1_8b_wanda_24_nsamples128-w4-g128-awq-v2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f134df1885dc0676f9ad62f8b6fde9831416f8c2a08879144181fcdb47ab0265
3
+ size 5809934884