Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-8B-Instruct-v0.9-GGUF
like
2
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
text-generation-inference
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
444336d
Llama-3-8B-Instruct-v0.9-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
5e065e749ea489812ef2e09352c98d5d4c4deaf85aea1aa65ff6acfc79119b42
444336d
verified
4 months ago
.gitattributes
2.32 kB
5e065e749ea489812ef2e09352c98d5d4c4deaf85aea1aa65ff6acfc79119b42
4 months ago
Llama-3-8B-Instruct-v0.9.IQ1_M.gguf
2.16 GB
LFS
8ef7f5017d66af671e1d702e23ce05a96aeb5b81d60a267570aed963edcc550d
4 months ago
Llama-3-8B-Instruct-v0.9.IQ2_XS.gguf
2.61 GB
LFS
586a586a2233bc35020f0b191235efeabcd323baf0d0c29d690edf52eb167b37
4 months ago
Llama-3-8B-Instruct-v0.9.IQ3_XS.gguf
3.52 GB
LFS
f7aacdbbe6363b034211e76138b8757c6d86cff2b8ab158407a20bff4db23292
4 months ago
Llama-3-8B-Instruct-v0.9.IQ4_XS.gguf
4.45 GB
LFS
05202e68ad15b42727abc0acb2cff349bd3b8da08ad864329c5002fb3b9b69e0
4 months ago
Llama-3-8B-Instruct-v0.9.Q2_K.gguf
3.18 GB
LFS
20b7bb558706a8189750ccb594ca3d26f415b52bb33ce1313d8f194c85baa6e9
4 months ago
Llama-3-8B-Instruct-v0.9.Q3_K_L.gguf
4.32 GB
LFS
dbd722ff8d77984ebf9a4b90daa15a6dd783e9fdb100519988cfeed0ecec45d3
4 months ago
Llama-3-8B-Instruct-v0.9.Q3_K_M.gguf
4.02 GB
LFS
c4b7418849fb03a1209fd873a33778af6c447ae0fe4488f5fb248175dc7edf4e
4 months ago
Llama-3-8B-Instruct-v0.9.Q3_K_S.gguf
3.66 GB
LFS
7e99768172d18a57a0b17a23898101a46c452448c0c130267083534bb77b0289
4 months ago
Llama-3-8B-Instruct-v0.9.Q4_K_M.gguf
4.92 GB
LFS
60613fde9fec137ec639e148668e4f7446f3d029c886be6a63bc1ef37160d3d0
4 months ago
Llama-3-8B-Instruct-v0.9.Q4_K_S.gguf
4.69 GB
LFS
c3f5da97c2b85362c2060fd445e797975d458b30e53ceb7ac6f030f4d7086f93
4 months ago
Llama-3-8B-Instruct-v0.9.Q5_K_M.gguf
5.73 GB
LFS
5e065e749ea489812ef2e09352c98d5d4c4deaf85aea1aa65ff6acfc79119b42
4 months ago
README.md
27 Bytes
initial commit
4 months ago
