Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-8B-Instruct-v0.9-GGUF
like
2
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
40ea7b5
Llama-3-8B-Instruct-v0.9-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
c4b7418849fb03a1209fd873a33778af6c447ae0fe4488f5fb248175dc7edf4e
40ea7b5
verified
3 months ago
.gitattributes
2.03 kB
c4b7418849fb03a1209fd873a33778af6c447ae0fe4488f5fb248175dc7edf4e
3 months ago
Llama-3-8B-Instruct-v0.9.IQ1_M.gguf
2.16 GB
LFS
8ef7f5017d66af671e1d702e23ce05a96aeb5b81d60a267570aed963edcc550d
3 months ago
Llama-3-8B-Instruct-v0.9.IQ2_XS.gguf
2.61 GB
LFS
586a586a2233bc35020f0b191235efeabcd323baf0d0c29d690edf52eb167b37
3 months ago
Llama-3-8B-Instruct-v0.9.IQ3_XS.gguf
3.52 GB
LFS
f7aacdbbe6363b034211e76138b8757c6d86cff2b8ab158407a20bff4db23292
3 months ago
Llama-3-8B-Instruct-v0.9.IQ4_XS.gguf
4.45 GB
LFS
05202e68ad15b42727abc0acb2cff349bd3b8da08ad864329c5002fb3b9b69e0
3 months ago
Llama-3-8B-Instruct-v0.9.Q2_K.gguf
3.18 GB
LFS
20b7bb558706a8189750ccb594ca3d26f415b52bb33ce1313d8f194c85baa6e9
3 months ago
Llama-3-8B-Instruct-v0.9.Q3_K_L.gguf
4.32 GB
LFS
dbd722ff8d77984ebf9a4b90daa15a6dd783e9fdb100519988cfeed0ecec45d3
3 months ago
Llama-3-8B-Instruct-v0.9.Q3_K_M.gguf
4.02 GB
LFS
c4b7418849fb03a1209fd873a33778af6c447ae0fe4488f5fb248175dc7edf4e
3 months ago
README.md
27 Bytes
initial commit
3 months ago