Hugging Face's logo

unsloth
/
Llama-3.2-1B-Instruct-GGUF

Transformers
GGUF
English
llama-3
llama
meta
facebook
unsloth
Inference Endpoints
conversational
Model card Files Community
danielhanchen commited on
Commit
3fd4566
•
1 Parent(s): 2293a97

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. Llama-3.2-1B-Instruct-F16.gguf +3 -0
  3. Llama-3.2-1B-Instruct-Q2_K.gguf +3 -0
  4. Llama-3.2-1B-Instruct-Q3_K_M.gguf +3 -0
  5. Llama-3.2-1B-Instruct-Q4_K_M.gguf +3 -0
  6. Llama-3.2-1B-Instruct-Q5_K_M.gguf +3 -0
  7. Llama-3.2-1B-Instruct-Q6_K.gguf +3 -0
  8. Llama-3.2-1B-Instruct-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Llama-3.2-1B-Instruct-F16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Llama-3.2-1B-Instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Llama-3.2-1B-Instruct-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Llama-3.2-1B-Instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Llama-3.2-1B-Instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Llama-3.2-1B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Llama-3.2-1B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-1B-Instruct-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59c710fd5ed4aeb4da222d43c4a7fb3427e9d39523496f0a07233f208c85f990
3
+ size 2474390336
Llama-3.2-1B-Instruct-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15d5fb6c43412de91579fd97ce63b550cf6c1c6c5e16c4643e27bb1ae5da5165
3
+ size 575669056
Llama-3.2-1B-Instruct-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2985522fd1938c53d9c9904133f78f9d3de471f45843635a50407b50a1eb756
3
+ size 685638464
Llama-3.2-1B-Instruct-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55bcfe29dd201753c2dc4ef7a99c6ab6ee1892314ae1aa750d25e5b3648402ac
3
+ size 802489152
Llama-3.2-1B-Instruct-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7bda42be93f801d45a5e3c43280de4268d17b4474db6de287ea9441c48cd39b
3
+ size 906298176
Llama-3.2-1B-Instruct-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a5b0fc19dd27784ea9806992056d0afd66821853bb1ad4d7e9cefda9d0b5672
3
+ size 1016595264
Llama-3.2-1B-Instruct-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eaaeacbd1d9240398f9a9fb4bf7f4ec8f273055d76fd1f386632d75c0ebcb887
3
+ size 1315877696