Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
KONI-Llama3-8B-20240630-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
KONI-Llama3-8B-20240630-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
202c39d8307c82841252c9e8a9de5fdc3d526c9bf97ab7434e53b33e62ca58d6
a623c21
verified
4 months ago
.gitattributes
Safe
2.02 kB
202c39d8307c82841252c9e8a9de5fdc3d526c9bf97ab7434e53b33e62ca58d6
4 months ago
KONI-Llama3-8B-20240630-GGUF_imatrix.dat
4.99 MB
LFS
202c39d8307c82841252c9e8a9de5fdc3d526c9bf97ab7434e53b33e62ca58d6
4 months ago
KONI-Llama3-8B-20240630.Q4_K_M.gguf
Safe
4.92 GB
LFS
962a6e2ac5d60e70437b05e64dbcc4b5d3115dd680438fd61b90728a20e81c5b
4 months ago
KONI-Llama3-8B-20240630.Q5_K_M.gguf
Safe
5.73 GB
LFS
6cdda76f189d007b09657a94334fb9fe7ca7f4253e627c726c2041388a63ea70
4 months ago
KONI-Llama3-8B-20240630.Q5_K_S.gguf
Safe
5.6 GB
LFS
5f242f6d0268126773681cba508c095ed2b994f98be94bc1f6251971b32135ec
4 months ago
KONI-Llama3-8B-20240630.Q6_K.gguf
Safe
6.6 GB
LFS
d65a54903b199acf242ca8027391be4ad13b88aae6ddabd0d5bdb2de2a5cd32a
4 months ago
KONI-Llama3-8B-20240630.Q8_0.gguf
Safe
8.54 GB
LFS
cb5c63931756bde2d028cc69609436d2495011850b235945b43c7c373b89fd8a
4 months ago
KONI-Llama3-8B-20240630.fp16.gguf
Safe
16.1 GB
LFS
c2f7a4989fa2877a8e95495ca040479cf74a995e6fee8265d40a356dcc19b758
4 months ago
README.md
Safe
3.03 kB
202c39d8307c82841252c9e8a9de5fdc3d526c9bf97ab7434e53b33e62ca58d6
4 months ago
