Transformers
GGUF
llama
text-generation-inference
TheBloke commited on
Commit
a8a335e
1 Parent(s): c67cf70

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 465219b)

Browse files
.gitattributes CHANGED
@@ -43,3 +43,5 @@ agentlm-70b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
  agentlm-70b.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
44
  agentlm-70b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
  agentlm-70b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
43
  agentlm-70b.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
44
  agentlm-70b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
  agentlm-70b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
+ agentlm-70b.Q6_K.gguf-split-a filter=lfs diff=lfs merge=lfs -text
47
+ agentlm-70b.Q6_K.gguf-split-b filter=lfs diff=lfs merge=lfs -text
agentlm-70b.Q6_K.gguf-split-a ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af81746fd48ee8e47bfc143ceabbe4f220569e29eec68a4a1c1b925966e827c8
3
+ size 28295407578
agentlm-70b.Q6_K.gguf-split-b ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b51ca95124c79061a26c77904a0fb410ae6d5b7714ba05b53ca850d991d479f
3
+ size 28295407558