Transformers
GGUF
llama
text-generation-inference
TheBloke commited on
Commit
3834022
1 Parent(s): a8a335e

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 465219b)

Browse files
.gitattributes CHANGED
@@ -45,3 +45,5 @@ agentlm-70b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
  agentlm-70b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
  agentlm-70b.Q6_K.gguf-split-a filter=lfs diff=lfs merge=lfs -text
47
  agentlm-70b.Q6_K.gguf-split-b filter=lfs diff=lfs merge=lfs -text
 
 
 
45
  agentlm-70b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
  agentlm-70b.Q6_K.gguf-split-a filter=lfs diff=lfs merge=lfs -text
47
  agentlm-70b.Q6_K.gguf-split-b filter=lfs diff=lfs merge=lfs -text
48
+ agentlm-70b.Q8_0.gguf-split-a filter=lfs diff=lfs merge=lfs -text
49
+ agentlm-70b.Q8_0.gguf-split-b filter=lfs diff=lfs merge=lfs -text
agentlm-70b.Q8_0.gguf-split-a ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1981294e90bbbb0074213db95571aa4f0daa1ce25342f6d6f92c9fd58f85ca36
3
+ size 36648396762
agentlm-70b.Q8_0.gguf-split-b ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a1c3a92a49d99552c21efb32f0801617e13b5c14a00021584b612b226cca31f
3
+ size 36648396742