Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-8B-Instruct-v0.9-GGUF
like
2
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
75de369
Llama-3-8B-Instruct-v0.9-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
20b7bb558706a8189750ccb594ca3d26f415b52bb33ce1313d8f194c85baa6e9
75de369
verified
5 months ago
.gitattributes
1.88 kB
20b7bb558706a8189750ccb594ca3d26f415b52bb33ce1313d8f194c85baa6e9
5 months ago
Llama-3-8B-Instruct-v0.9.IQ1_M.gguf
2.16 GB
LFS
8ef7f5017d66af671e1d702e23ce05a96aeb5b81d60a267570aed963edcc550d
5 months ago
Llama-3-8B-Instruct-v0.9.IQ2_XS.gguf
2.61 GB
LFS
586a586a2233bc35020f0b191235efeabcd323baf0d0c29d690edf52eb167b37
5 months ago
Llama-3-8B-Instruct-v0.9.IQ3_XS.gguf
3.52 GB
LFS
f7aacdbbe6363b034211e76138b8757c6d86cff2b8ab158407a20bff4db23292
5 months ago
Llama-3-8B-Instruct-v0.9.IQ4_XS.gguf
4.45 GB
LFS
05202e68ad15b42727abc0acb2cff349bd3b8da08ad864329c5002fb3b9b69e0
5 months ago
Llama-3-8B-Instruct-v0.9.Q2_K.gguf
3.18 GB
LFS
20b7bb558706a8189750ccb594ca3d26f415b52bb33ce1313d8f194c85baa6e9
5 months ago
README.md
27 Bytes
initial commit
5 months ago