Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3-70B-Instruct-GGUF

Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
Model card Files Community
20
MaziyarPanahi commited on
Commit
0963ac2
•
1 Parent(s): 0cdb526

Upload folder using huggingface_hub (#4)

Browse files

- f29802c18c473e41331cfdb68d9bb933d99f884a4910ce33af966b2c56c474e1 (72299868bc1d41b4bd99e4dc94ad94bd2aab9290)
- 2d76773f963201600f1d6ca5a5fbc4cb792fb0da0937505487bd3e5ef61213ee (468263809dfd2e9b46a08d076c61fac12320abb1)
- 1a9d427b6f4c0bf4be0b68cbd26bc0dfdb0fe4abe284b42ce4222acfc9329aba (ed213a1fc0886882132a2dbd28a4f3abfda53a7f)
- ed659287a39409ebfffa53e6980d04251a161c9ea5fa07ebb3582f6542a63784 (48fdc5070bdcda451aee4bba14caa0a69be448da)
- a70ec63d55aeca648e089bf54fd31d089cc588a4c816b472034748c1d0b0a608 (dc46d7b993c4b71cdb3331c1103e511f93346e15)
- 2d32acc799e7a3ed09bf7bccd73bb3def5a9eb5d0d42ef77b210dcb3d41503ee (04b75a66df88a9337442126576ed2cee0ac172dd)

Files changed (5) hide show
  1. .gitattributes +4 -0
  2. Meta-Llama-3-70B-Instruct.IQ4_XS.gguf +3 -0
  3. Meta-Llama-3-70B-Instruct.Q3_K_L.gguf +3 -0
  4. Meta-Llama-3-70B-Instruct.Q3_K_M.gguf +3 -0
  5. Meta-Llama-3-70B-Instruct.Q4_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -36,3 +36,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  Meta-Llama-3-70B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
  Meta-Llama-3-70B-Instruct.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
38
  Meta-Llama-3-70B-Instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
36
  Meta-Llama-3-70B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
  Meta-Llama-3-70B-Instruct.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
38
  Meta-Llama-3-70B-Instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Meta-Llama-3-70B-Instruct.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Meta-Llama-3-70B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Meta-Llama-3-70B-Instruct.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Meta-Llama-3-70B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3-70B-Instruct.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da5984aa8b9cfde43cf9ce21c23b57fa4831cf218c181c2a5a6d2b90320e6187
3
+ size 38270175680
Meta-Llama-3-70B-Instruct.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4708ba46764811fe3c9454598282197787ba01bdb745a15b878df52c12e12067
3
+ size 37141105088
Meta-Llama-3-70B-Instruct.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffc76ff74022adb94c91442a6eea9a19d3f3568afdc79f03b82b848ff32d81a8
3
+ size 34268006848
Meta-Llama-3-70B-Instruct.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a571f8ad70be74c3546458b1bb49e7a9c4b7cfcad30434ecd1ec94ae899bbb8
3
+ size 40347732416