Hugging Face's logo

NousResearch
/
Hermes-3-Llama-3.1-70B-GGUF

GGUF
English
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
Inference Endpoints
conversational
Model card Files Community
2
emozilla commited on
Commit
3a2f756
•
1 Parent(s): 2a51922

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. Hermes-3-Llama-3.1-70B.Q3_K_L.gguf +3 -0
  3. Hermes-3-Llama-3.1-70B.Q3_K_M.gguf +3 -0
  4. Hermes-3-Llama-3.1-70B.Q3_K_S.gguf +3 -0
  5. Hermes-3-Llama-3.1-70B.Q4_K_M.gguf +3 -0
  6. Hermes-3-Llama-3.1-70B.Q4_K_S.gguf +3 -0
  7. Hermes-3-Llama-3.1-70B.Q5_K_M.gguf +3 -0
  8. Hermes-3-Llama-3.1-70B.Q5_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Hermes-3-Llama-3.1-70B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Hermes-3-Llama-3.1-70B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Hermes-3-Llama-3.1-70B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Hermes-3-Llama-3.1-70B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Hermes-3-Llama-3.1-70B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Hermes-3-Llama-3.1-70B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Hermes-3-Llama-3.1-70B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Hermes-3-Llama-3.1-70B.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:342cb8e41e3ca3aca4a37d337804bce10db939bca6e36d1155ccdc3536f081d2
3
+ size 37140591904
Hermes-3-Llama-3.1-70B.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:feb534e77844c41561e9ee67898ca9e577884a6b97b6c290509575401fb09984
3
+ size 34267493664
Hermes-3-Llama-3.1-70B.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71209ec95a4b67fdb014deb5f5152053fa81ebd1ab8d194679ca7f7c3f64d634
3
+ size 30912050464
Hermes-3-Llama-3.1-70B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:955c2f42caade4278f3c9dbffa32bb74572652b20e49e5340e782de3585bbe3f
3
+ size 42520392992
Hermes-3-Llama-3.1-70B.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:723a750f99e3943e6708354c9e322e098b9633285b38dd06611c7191e000b800
3
+ size 40347219232
Hermes-3-Llama-3.1-70B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10ae3e0441b14c4a6476436f3c14e8bcacc7928aa3e8ce978d053287289a7ebb
3
+ size 49949816096
Hermes-3-Llama-3.1-70B.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24b29d1725d3ece4a01499fff9f692d98a5132ffdb8251ee54eca0f18ffa9501
3
+ size 48657446176