Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card Files Community
7
MaziyarPanahi commited on
Commit
1b4fae1
·
verified ·
1 Parent(s): e8d7874

[WIP] Upload folder using huggingface_hub (multi-commit 1f8d4d75162b00be5bf2935302e4354812d5218d19a975daf80ce1853a79cb04) (#1)

Browse files

- 2b3c4d77c4eb8c500e90da8f9b46d958796ed1dc7239b4af501706db15f2ab7d (cfd9a0108a249d74a221e455bc01381ce07c84dd)
- 39bdc99bfcb15b687b622fec3f198b6815ed165e8bd27a8c04d87115576ae6d0 (9985ee3df290432ff8c698bd4ef9211e082a925e)
- 1631249b035a5f99ff14d8afa45121321fdfb1f7e72ee8e5d9b69acb5960eb99 (a73b6a1385ab9acf875cc156053a9b20cc59e98d)
- 4e6bcfe7735d52f4413bcc3467309f462f76c4faec3f2dd2124d6d40ecbdf5bd (b3ee5f52d6e48dcfdc462a96abab1ff4cdcf76e2)
- f25b3e1661f3b67b86ffe870505cea82a3e5be351e36884c4d9b2ae89c4b1c68 (41bc3e03a3d9c819c92fec7da5167c7c66ab63d8)
- 4c9bc48f5eadae12c3849299d870d179ec56d9613c71e9592c1f32306745ecaa (40d0301a2564eb7b0fb253ae1627696f182e5fe9)
- 746fb025e4afe5a5a4f5f9f1d66558193414975cda1a23c3125821fe6b1bb9e9 (d540a30a17737e3a862a5c0e908a0af0850e3def)
- cba7b2291e54f58c7ca2d53ca2207de2b0fbe1bfb20bfddf9314535e73164e81 (d17cb42d9a9f4acfc8472cdaf452d181cbb2bdcb)

Files changed (9) hide show
  1. .gitattributes +8 -0
  2. Meta-Llama-3.1-70B-Instruct.Q2_K.gguf +3 -0
  3. Meta-Llama-3.1-70B-Instruct.Q3_K_L.gguf +3 -0
  4. Meta-Llama-3.1-70B-Instruct.Q3_K_M.gguf +3 -0
  5. Meta-Llama-3.1-70B-Instruct.Q3_K_S.gguf +3 -0
  6. Meta-Llama-3.1-70B-Instruct.Q4_K_M.gguf +3 -0
  7. Meta-Llama-3.1-70B-Instruct.Q4_K_S.gguf +3 -0
  8. Meta-Llama-3.1-70B-Instruct.Q5_K_M.gguf +3 -0
  9. Meta-Llama-3.1-70B-Instruct.Q5_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Meta-Llama-3.1-70B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Meta-Llama-3.1-70B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Meta-Llama-3.1-70B-Instruct.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Meta-Llama-3.1-70B-Instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Meta-Llama-3.1-70B-Instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Meta-Llama-3.1-70B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Meta-Llama-3.1-70B-Instruct.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Meta-Llama-3.1-70B-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3.1-70B-Instruct.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08b70ba58c9bd0da4ec7c725cee05c7795565f2a142fff33c4c5612dfe8493b1
3
+ size 26375108736
Meta-Llama-3.1-70B-Instruct.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4aca3bd69ed9ad42e4c7c6acb6bddcbd1897c1b0b2ae6449c5deb35d3dcafabc
3
+ size 37140592768
Meta-Llama-3.1-70B-Instruct.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edaa3775e4f3599a9e3ff576492f9da11e18c10ccbbc1b52b67eb90660a1b0a9
3
+ size 34267494528
Meta-Llama-3.1-70B-Instruct.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f953fe1cdeae9b4c6d8dd806d1c1223f2eaa5d900c23cf788d1aa0718c028ccd
3
+ size 30912051328
Meta-Llama-3.1-70B-Instruct.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f16ab17da4521fe3ed7c5d7beed960d3fe7b5b64421ee9650aa53d6b649ccab
3
+ size 42520393856
Meta-Llama-3.1-70B-Instruct.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7416595e813087dc83b504ca47236ae27f581f18627a731abe77ba8b4a638087
3
+ size 40347220096
Meta-Llama-3.1-70B-Instruct.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6973a51ab0535ff2b2ab3bc5d1e68f1ac3b7e10ad0c2a6f9a8437005518503ec
3
+ size 49949816960
Meta-Llama-3.1-70B-Instruct.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ed2763f5246fc23a3a7d01ef56ace5077dccb9beebea4a24eeb46cb8347798f
3
+ size 48657447040