Hugging Face's logo

l3utterfly
/
Impish_LLAMA_3B-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
l3utterfly commited on
Commit
9f54d69
·
1 Parent(s): add5609

Add quantised GGUF files

Browse files
Files changed (9) hide show
  1. .gitattributes +1 -0
  2. Impish_LLAMA_3B-Q2_K.gguf +3 -0
  3. Impish_LLAMA_3B-Q4_0_4_4.gguf +3 -0
  4. Impish_LLAMA_3B-Q4_0_4_8.gguf +3 -0
  5. Impish_LLAMA_3B-Q4_0_8_8.gguf +3 -0
  6. Impish_LLAMA_3B-Q4_K_M.gguf +3 -0
  7. Impish_LLAMA_3B-Q6_K.gguf +3 -0
  8. Impish_LLAMA_3B-Q8_0.gguf +3 -0
  9. Impish_LLAMA_3B-f16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
Impish_LLAMA_3B-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f459821869be1c0a960548e879656ba46a8e393143b11adc8dedcc1221384397
3
+ size 1363931968
Impish_LLAMA_3B-Q4_0_4_4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e03b6b5add767e35a103cea8894f1000a4738c6241a5234b2b1eb663f8413ba6
3
+ size 1917186880
Impish_LLAMA_3B-Q4_0_4_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:078c5066dee756498eca2f4a3902559b3b34d32830e8beecf53c5698efd49e41
3
+ size 1917186880
Impish_LLAMA_3B-Q4_0_8_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9d597099d162bd8669bf5228df153a694edfe1dd40497fd394e11ae05056d4e
3
+ size 1917186880
Impish_LLAMA_3B-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0cd0d0824ba6e804514a9c18786a14b469b70c1a6579dfa8d44a5e79fadebbd
3
+ size 2019373888
Impish_LLAMA_3B-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc385250793652adf715655cace041d502e66c61065ff2e1eb09662f64ace105
3
+ size 2643850048
Impish_LLAMA_3B-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee41b5973c4e31f823e0769906cecee83a67a6c693fb7e6b0415846ee2882ca8
3
+ size 3421895488
Impish_LLAMA_3B-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea9869f6a08d20f610b5dc99d1786cb5dcbf8bbf5db6e6797f7dae83d160848f
3
+ size 6433684288