Hugging Face's logo

MaziyarPanahi
/
Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
text-generation-inference
Model card Files Community
10

Upload folder using huggingface_hub

#5
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/5
Discussion Files changed
+20
-0
Files changed (6) hide show
  1. .gitattributes +5 -0
  2. Llama-3-8B-Instruct-32k-v0.1.IQ1_M.gguf +3 -0
  3. Llama-3-8B-Instruct-32k-v0.1.IQ1_S.gguf +3 -0
  4. Llama-3-8B-Instruct-32k-v0.1.IQ2_XS.gguf +3 -0
  5. Llama-3-8B-Instruct-32k-v0.1.IQ3_XS.gguf +3 -0
  6. Llama-3-8B-Instruct-32k-v0.1.IQ4_XS.gguf +3 -0
.gitattributes CHANGED
@@ -44,3 +44,8 @@ Llama-3-8B-Instruct-32k-v0.1.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
  Llama-3-8B-Instruct-32k-v0.1.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
  Llama-3-8B-Instruct-32k-v0.1.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
46
  Llama-3-8B-Instruct-32k-v0.1.fp16.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
44
  Llama-3-8B-Instruct-32k-v0.1.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
  Llama-3-8B-Instruct-32k-v0.1.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
46
  Llama-3-8B-Instruct-32k-v0.1.fp16.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Llama-3-8B-Instruct-32k-v0.1.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Llama-3-8B-Instruct-32k-v0.1.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Llama-3-8B-Instruct-32k-v0.1.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Llama-3-8B-Instruct-32k-v0.1.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Llama-3-8B-Instruct-32k-v0.1.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct-32k-v0.1.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da2fcce3d8c58bc2a755fe27d678063a507b87fd1098abe25ab0f605b96a7c7f
3
+ size 2161971456
Llama-3-8B-Instruct-32k-v0.1.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1dcb15882bf8150acc1cfc674068c3bfbc774da26c6c696f757f4b6721974ccc
3
+ size 2019627264
Llama-3-8B-Instruct-32k-v0.1.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83769ca2286890e43ea38db8d7ea9986da1bc17dbd80005c24bc75c099dced9b
3
+ size 2605781248
Llama-3-8B-Instruct-32k-v0.1.IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ff1b951b4ff829b2d7efbc256f2601d96e03326213b2779b14bfc40ab96d80a
3
+ size 3518746880
Llama-3-8B-Instruct-32k-v0.1.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:871e5fdb3b7af047da25712a800c06cc9bd049139273e53cea0b3c77b86cdb4f
3
+ size 4447662336