Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Casual-Autopsy
/
vntl-llama3-8b-v2-imatrix-gguf
like
0
Translation
GGUF
English
Japanese
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
8be73f9
vntl-llama3-8b-v2-imatrix-gguf
1 contributor
History:
7 commits
Casual-Autopsy
Upload Q6 Quants
8be73f9
verified
15 days ago
.gitattributes
Safe
2.67 kB
Upload Q6 Quants
15 days ago
README.md
Safe
97 Bytes
Create README.md
15 days ago
imatrix.dat
4.99 MB
LFS
Upload imatrix.dat
16 days ago
vntl-llama3-8b-v2-hf-iq3_m.gguf
Safe
3.78 GB
LFS
Upload Q3 Quants
15 days ago
vntl-llama3-8b-v2-hf-iq3_xs.gguf
Safe
3.52 GB
LFS
Upload Q3 Quants
15 days ago
vntl-llama3-8b-v2-hf-iq4_nl.gguf
Safe
4.68 GB
LFS
Upload Q4 Quants
15 days ago
vntl-llama3-8b-v2-hf-iq4_xs.gguf
Safe
4.45 GB
LFS
Upload Q4 Quants
15 days ago
vntl-llama3-8b-v2-hf-q3_k_l.gguf
Safe
4.32 GB
LFS
Upload Q3 Quants
15 days ago
vntl-llama3-8b-v2-hf-q3_k_m.gguf
Safe
4.02 GB
LFS
Upload Q3 Quants
15 days ago
vntl-llama3-8b-v2-hf-q3_k_s.gguf
Safe
3.66 GB
LFS
Upload Q3 Quants
15 days ago
vntl-llama3-8b-v2-hf-q3_k_xl.gguf
Safe
4.78 GB
LFS
Upload Q3 Quants
15 days ago
vntl-llama3-8b-v2-hf-q4_k_l.gguf
Safe
5.31 GB
LFS
Upload Q4 Quants
15 days ago
vntl-llama3-8b-v2-hf-q4_k_m.gguf
Safe
4.92 GB
LFS
Upload Q4 Quants
15 days ago
vntl-llama3-8b-v2-hf-q4_k_s.gguf
Safe
4.69 GB
LFS
Upload Q4 Quants
15 days ago
vntl-llama3-8b-v2-hf-q5_k_l.gguf
Safe
6.06 GB
LFS
Upload Q5 Quants
15 days ago
vntl-llama3-8b-v2-hf-q5_k_m.gguf
Safe
5.73 GB
LFS
Upload Q5 Quants
15 days ago
vntl-llama3-8b-v2-hf-q5_k_s.gguf
Safe
5.6 GB
LFS
Upload Q5 Quants
15 days ago
vntl-llama3-8b-v2-hf-q6_k.gguf
Safe
6.6 GB
LFS
Upload Q6 Quants
15 days ago
vntl-llama3-8b-v2-hf-q6_k_l.gguf
Safe
6.85 GB
LFS
Upload Q6 Quants
15 days ago