Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-11B-Instruct-v0.1-GGUF
like
7
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
text-generation-inference
conversational
Model card
Files
Files and versions
Community
3
Train
Deploy
Use this model
d26e498
Llama-3-11B-Instruct-v0.1-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
07b191d8b3e9ee85ea2af0ec625864af4188aa4c5943619f09bd6396b822e9e2
d26e498
verified
6 months ago
.gitattributes
2.33 kB
07b191d8b3e9ee85ea2af0ec625864af4188aa4c5943619f09bd6396b822e9e2
6 months ago
Llama-3-11B-Instruct-v0.1.IQ3_XS.gguf
4.95 GB
LFS
a7f00d4eff1c283944153c1a44db49bc4cba7e02c4a9570e03a8c041919650e9
6 months ago
Llama-3-11B-Instruct-v0.1.IQ4_XS.gguf
6.37 GB
LFS
9bae712c23912607911c39f7702509f473097a13c82a682dbb194e34a76b702b
6 months ago
Llama-3-11B-Instruct-v0.1.Q2_K.gguf
4.46 GB
LFS
ded94c39fa1314af10e0f436c605953d601ad4fec8c738417bef08c7857b7877
6 months ago
Llama-3-11B-Instruct-v0.1.Q3_K_L.gguf
6.15 GB
LFS
1993fca72b08c6659d37df41aa7e87779e77823e493fbc095f7297af501164eb
6 months ago
Llama-3-11B-Instruct-v0.1.Q3_K_M.gguf
5.7 GB
LFS
13d705165e8358a6982bb71a21f540ba8aac040b8a9ba75342d536e3ec0ed181
6 months ago
Llama-3-11B-Instruct-v0.1.Q3_K_S.gguf
5.17 GB
LFS
7469a15be5914d7bcefbc253f68690e253ebe335b6665db6b9e256f7225b6b7e
6 months ago
Llama-3-11B-Instruct-v0.1.Q4_K_M.gguf
7.01 GB
LFS
4562dcd305ace5c4f2149375ddcac8739550f87c323825877b7b1b1cc2ac90d8
6 months ago
Llama-3-11B-Instruct-v0.1.Q4_K_S.gguf
6.67 GB
LFS
50317e020acd764bf142dbbcaef776412fee94a748da79f63d0ab63b3e372672
6 months ago
Llama-3-11B-Instruct-v0.1.Q5_K_M.gguf
8.2 GB
LFS
a8e8e87f1d5bb856970bc47b6b2c36cb25b74cde335b49e13f0a56b3879e8813
6 months ago
Llama-3-11B-Instruct-v0.1.Q5_K_S.gguf
8 GB
LFS
54992e4a7bb638d704dfc9638027363817ee5f8ebd9a0ca936439a69586e8aec
6 months ago
Llama-3-11B-Instruct-v0.1.Q6_K.gguf
9.46 GB
LFS
07b191d8b3e9ee85ea2af0ec625864af4188aa4c5943619f09bd6396b822e9e2
6 months ago
