1 contributor

History: 14 commits

TheBloke

GGUF model commit (made with llama.cpp commit fecac45)

2cd20d9 11 months ago

.gitattributes

2.42 kB

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
marcoroni-neural-chat-7b-v1.Q2_K.gguf

3.08 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
marcoroni-neural-chat-7b-v1.Q3_K_L.gguf

3.82 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
marcoroni-neural-chat-7b-v1.Q3_K_M.gguf

3.52 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
marcoroni-neural-chat-7b-v1.Q3_K_S.gguf

3.16 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
marcoroni-neural-chat-7b-v1.Q4_0.gguf

4.11 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
marcoroni-neural-chat-7b-v1.Q4_K_M.gguf

4.37 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
marcoroni-neural-chat-7b-v1.Q4_K_S.gguf

4.14 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
marcoroni-neural-chat-7b-v1.Q5_0.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
marcoroni-neural-chat-7b-v1.Q5_K_M.gguf

5.13 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
marcoroni-neural-chat-7b-v1.Q5_K_S.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
marcoroni-neural-chat-7b-v1.Q6_K.gguf

5.94 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
marcoroni-neural-chat-7b-v1.Q8_0.gguf

7.7 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago