Hugging Face's logo

MaziyarPanahi
/
Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
Model card Files Community
2

[WIP] Upload folder using huggingface_hub (multi-commit 7348e1aee527ac66c4f7d7d53ebff477d70bdc7d7093de1d289b7b96f3c6e573)

#1
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+32
-0
Files changed (9) hide show
  1. .gitattributes +8 -0
  2. Llama-3-Groq-70B-Tool-Use.Q2_K.gguf +3 -0
  3. Llama-3-Groq-70B-Tool-Use.Q3_K_L.gguf +3 -0
  4. Llama-3-Groq-70B-Tool-Use.Q3_K_M.gguf +3 -0
  5. Llama-3-Groq-70B-Tool-Use.Q3_K_S.gguf +3 -0
  6. Llama-3-Groq-70B-Tool-Use.Q4_K_M.gguf +3 -0
  7. Llama-3-Groq-70B-Tool-Use.Q4_K_S.gguf +3 -0
  8. Llama-3-Groq-70B-Tool-Use.Q5_K_M.gguf +3 -0
  9. Llama-3-Groq-70B-Tool-Use.Q5_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Llama-3-Groq-70B-Tool-Use.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Llama-3-Groq-70B-Tool-Use.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Llama-3-Groq-70B-Tool-Use.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Llama-3-Groq-70B-Tool-Use.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Llama-3-Groq-70B-Tool-Use.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Llama-3-Groq-70B-Tool-Use.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Llama-3-Groq-70B-Tool-Use.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Llama-3-Groq-70B-Tool-Use.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-Groq-70B-Tool-Use.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0f15e0aa4e47a6cc6b58ed5987e53f1b0631d3680bd774622de2d435f0c90e8
3
+ size 26375165024
Llama-3-Groq-70B-Tool-Use.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:299e3f36d6fb4a2e45e8f01218571d58177178cc870ef5b9f3d6ab292422f3d6
3
+ size 37140654048
Llama-3-Groq-70B-Tool-Use.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18275c58c9a7ab7db2085557bc4cd830739e95e9eaa4cc6cc61d78a36c5296e4
3
+ size 34267555808
Llama-3-Groq-70B-Tool-Use.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a317c57a2ee95ffb55151c52aa46e2d9292ae3f2c909fd7136f78d9f3d8ae2ba
3
+ size 30912112608
Llama-3-Groq-70B-Tool-Use.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c11bb90627daad38c41f65232c4baeb9e918944ace3b876519c247c6e4e29815
3
+ size 42520461664
Llama-3-Groq-70B-Tool-Use.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6643bb3262d0c34d8ef114245ff123e566afefa497979c836bcc7e7e69cbfb02
3
+ size 40347287904
Llama-3-Groq-70B-Tool-Use.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:174b70d4b1a9e72221b288dfddec7fa61e42ff837b3e9036bb2b181d2e142969
3
+ size 49949890912
Llama-3-Groq-70B-Tool-Use.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1378e61533a1a14fc467046ac0484fd2a2d97df32774ec66f97b6a8bc333aef0
3
+ size 48657520992