Hugging Face's logo

LiteLLMs
/
Meta-Llama-3-8B-Instruct-GGUF

Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
GGUF
Inference Endpoints
conversational
Model card Files Community
andrijdavid commited on
Commit
2124d7c
·
verified ·
1 Parent(s): ef6cae8

Upload folder using huggingface_hub

Browse files
Files changed (6) hide show
  1. .gitattributes +5 -0
  2. Q6_K/Q6_K-00001-of-00005.gguf +3 -0
  3. Q6_K/Q6_K-00002-of-00005.gguf +3 -0
  4. Q6_K/Q6_K-00003-of-00005.gguf +3 -0
  5. Q6_K/Q6_K-00004-of-00005.gguf +3 -0
  6. Q6_K/Q6_K-00005-of-00005.gguf +3 -0
.gitattributes CHANGED
@@ -93,3 +93,8 @@ Q5_K_M/Q5_K_M-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
93
  Q5_K_M/Q5_K_M-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
94
  Q5_K_M/Q5_K_M-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
95
  Q5_K_M/Q5_K_M-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
93
  Q5_K_M/Q5_K_M-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
94
  Q5_K_M/Q5_K_M-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
95
  Q5_K_M/Q5_K_M-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
96
+ Q6_K/Q6_K-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
97
+ Q6_K/Q6_K-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
98
+ Q6_K/Q6_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
99
+ Q6_K/Q6_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
100
+ Q6_K/Q6_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/Q6_K-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a09a03e975ac39be86571bfb13aa0c7d9835c9f42a178101e320d797f3a2856d
3
+ size 1691897952
Q6_K/Q6_K-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3adb196933048c2d4df3387b64c47591556972a0dd0c211a42b12dc4ef48f3c6
3
+ size 1252642656
Q6_K/Q6_K-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1876ff968eb6f26f39827ce555c1f4c7d11f28c8647a549e00473db7cc04d5fd
3
+ size 1300795232
Q6_K/Q6_K-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d60fc0f8b174f6a2a9b689d61a9e53358281d1962d70ff6d2b55ba4f6a939494
3
+ size 1300795232
Q6_K/Q6_K-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6179bb831accedaabdd99ac99e4f9f7882512ef69f6f1149b91f5d338b699de
3
+ size 1050388640