Hugging Face's logo

second-state
/
TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation
Transformers
GGUF
llama
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
073a2c8
•
1 Parent(s): 701ebe4

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. TinyLlama-1.1B-Chat-v1.0-Q2_K.gguf +3 -0
  2. TinyLlama-1.1B-Chat-v1.0-Q3_K_L.gguf +3 -0
  3. TinyLlama-1.1B-Chat-v1.0-Q3_K_M.gguf +3 -0
  4. TinyLlama-1.1B-Chat-v1.0-Q3_K_S.gguf +3 -0
  5. TinyLlama-1.1B-Chat-v1.0-Q4_0.gguf +3 -0
  6. TinyLlama-1.1B-Chat-v1.0-Q4_K_M.gguf +3 -0
  7. TinyLlama-1.1B-Chat-v1.0-Q4_K_S.gguf +3 -0
  8. TinyLlama-1.1B-Chat-v1.0-Q5_0.gguf +3 -0
  9. TinyLlama-1.1B-Chat-v1.0-Q5_K_M.gguf +3 -0
  10. TinyLlama-1.1B-Chat-v1.0-Q5_K_S.gguf +3 -0
  11. TinyLlama-1.1B-Chat-v1.0-Q6_K.gguf +3 -0
  12. TinyLlama-1.1B-Chat-v1.0-Q8_0.gguf +3 -0
TinyLlama-1.1B-Chat-v1.0-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8bc959a26b2241c72728b6d8e279d121f44b445a67c9e0de158fa398f62105f
3
+ size 482143200
TinyLlama-1.1B-Chat-v1.0-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f57ebaf66c03a1c43f9b0235c5bb5de64fb8d359d0c41e3e2548eee944153706
3
+ size 591526880
TinyLlama-1.1B-Chat-v1.0-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f68b574eaf985b55dff05a7cd3eff7bbe428ae0b1e02f0cafdbc9b9bd8e9c0f6
3
+ size 549845984
TinyLlama-1.1B-Chat-v1.0-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85391a474c4f9b1e06053527ceafed1806da2ac998e8196f501f97b0ab8f128d
3
+ size 499342304
TinyLlama-1.1B-Chat-v1.0-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1e9f846753d010ea8cd9e5b2b75bea0932eab1e2f57cd23eeedfde63174a518
3
+ size 636726240
TinyLlama-1.1B-Chat-v1.0-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c66751b61537f9e55177b1b67e06af88e0e2df88f86de4909f5bf87fb1ae583
3
+ size 667814880
TinyLlama-1.1B-Chat-v1.0-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3511ed890fe80b3e40070e5f3763515c7a931628591e60e0d5ddc1329d00137
3
+ size 642755552
TinyLlama-1.1B-Chat-v1.0-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2648f7625dee5470084542c87923c574eceea1dd41fadf57f097f2cf98fb3fb8
3
+ size 766028768
TinyLlama-1.1B-Chat-v1.0-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4602b3e1751346bc22e6454fa2670f743351546401cb353a10c8b5329075e67f
3
+ size 782044128
TinyLlama-1.1B-Chat-v1.0-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04c060bdc8e428b0633ca444734061efaa5e3d105d61d463fc9987e272a938bd
3
+ size 766028768
TinyLlama-1.1B-Chat-v1.0-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:13eb268326c39cd68123efcbe2b600d371777eef25f827ec9a232be4d231d4fe
3
+ size 903412704
TinyLlama-1.1B-Chat-v1.0-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:269fba8f898f7f63aebeec25fbc0faedc36990cf277ee433c4ed16ca3faca7b1
3
+ size 1169808352