mradermacher
/

llama-3.1-8b-instruct-ortho-v6-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

llama-3.1-8b-instruct-ortho-v6-i1-GGUF

1 contributor

History: 11 commits

mradermacher's picture

uploaded from rich1

cd38204 verified 28 days ago

.gitattributes

2.14 kB

uploaded from rich1 28 days ago
README.md

257 Bytes

uploaded from rich1 28 days ago
imatrix.dat

4.99 MB
LFS

uploaded from rich1 28 days ago
llama-3.1-8b-instruct-ortho-v6.i1-IQ2_M.gguf

2.95 GB
LFS

uploaded from rich1 28 days ago
llama-3.1-8b-instruct-ortho-v6.i1-IQ3_M.gguf

3.78 GB
LFS

uploaded from rich1 28 days ago
llama-3.1-8b-instruct-ortho-v6.i1-IQ3_XXS.gguf

3.27 GB
LFS

uploaded from rich1 28 days ago
llama-3.1-8b-instruct-ortho-v6.i1-Q2_K.gguf

3.18 GB
LFS

uploaded from rich1 28 days ago
llama-3.1-8b-instruct-ortho-v6.i1-Q3_K_M.gguf

4.02 GB
LFS

uploaded from rich1 28 days ago
llama-3.1-8b-instruct-ortho-v6.i1-Q4_K_M.gguf

4.92 GB
LFS

uploaded from rich1 28 days ago
llama-3.1-8b-instruct-ortho-v6.i1-Q4_K_S.gguf

4.69 GB
LFS

uploaded from rich1 28 days ago