mradermacher
/

Unhinged-Llama3-8B-524K-GGUF

Inference Endpoints

Model card Files Files and versions Community

Unhinged-Llama3-8B-524K-GGUF

1 contributor

History: 17 commits

mradermacher's picture

uploaded from nethype/kaos

499dabe verified about 2 months ago

.gitattributes

2.52 kB

uploaded from nethype/kaos about 2 months ago
README.md

210 Bytes

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.IQ3_M.gguf
6.13 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.IQ3_S.gguf
5.95 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.IQ3_XS.gguf
5.66 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.IQ4_XS.gguf
7.31 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.Q2_K.gguf
5.11 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.Q3_K_L.gguf
7.07 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.Q3_K_M.gguf
6.53 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.Q3_K_S.gguf
5.91 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.Q4_K_M.gguf
8.06 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.Q4_K_S.gguf
7.66 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.Q5_K_M.gguf
9.43 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.Q5_K_S.gguf
9.2 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.Q6_K.gguf
10.9 GB
LFS

uploaded from nethype/kaos about 2 months ago
Unhinged-Llama3-8B-524K.Q8_0.gguf
14.1 GB
LFS

uploaded from nethype/kaos about 2 months ago