Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-8B-Instruct-32k-v0.1-GGUF
like
55
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
text-generation-inference
Model card
Files
Files and versions
Community
10
Train
Deploy
Use this model
cd16864
Llama-3-8B-Instruct-32k-v0.1-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
039a7d696e32ae49ac2c2dc977f36e69cf0395bc2414ec217d26011f5ccc04eb
cd16864
verified
3 months ago
.gitattributes
2.28 kB
039a7d696e32ae49ac2c2dc977f36e69cf0395bc2414ec217d26011f5ccc04eb
3 months ago
Llama-3-8B-Instruct-32k-v0.1.Q2_K.gguf
3.18 GB
LFS
9837045b7faa013e63894cc18f98e03f9a9dcc06de2842ec3b6317dacee4e4eb
3 months ago
Llama-3-8B-Instruct-32k-v0.1.Q3_K_L.gguf
4.32 GB
LFS
d46efb36ae78f06683e1ee8137408681df0972d69917bd96f1938fe350cb9c91
3 months ago
Llama-3-8B-Instruct-32k-v0.1.Q3_K_M.gguf
4.02 GB
LFS
28d89360035ec7f035da227115f8cb9cd97e8e36cccb250053b72b1e5ad7c2d0
3 months ago
Llama-3-8B-Instruct-32k-v0.1.Q3_K_S.gguf
3.66 GB
LFS
e917348eda876d29cbb56624e8f01013a0fdb06590bfbd9a907be4c1322aca6d
3 months ago
Llama-3-8B-Instruct-32k-v0.1.Q4_K_M.gguf
4.92 GB
LFS
5f73b08a3ecdcc9e1d805343f9f5901f03c2f692965e93eacefd6b2b48e5fbd1
3 months ago
Llama-3-8B-Instruct-32k-v0.1.Q4_K_S.gguf
4.69 GB
LFS
85935984e977215a761c69ddc015e254da2c4e87f392a6e1e0c24621b710abfa
3 months ago
Llama-3-8B-Instruct-32k-v0.1.Q5_K_M.gguf
5.73 GB
LFS
1fe0e6c06d8d783f086e686cf9e05f09ceb6748d8b039bfbb1c8aef6ba69c240
3 months ago
Llama-3-8B-Instruct-32k-v0.1.Q5_K_S.gguf
5.6 GB
LFS
bba4cfdc97627bdda1af677e8976834d61ca5306f82df95a4dae4810eefd33e5
3 months ago
Llama-3-8B-Instruct-32k-v0.1.Q6_K.gguf
6.6 GB
LFS
d053d359a250358b70892cf076aa06c60251103d68141644d79a31f39de75ada
3 months ago
Llama-3-8B-Instruct-32k-v0.1.Q8_0.gguf
8.54 GB
LFS
039a7d696e32ae49ac2c2dc977f36e69cf0395bc2414ec217d26011f5ccc04eb
3 months ago
