leafspark
/

DeepSeek-V2-Chat-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

DeepSeek-V2-Chat-GGUF

1 contributor

History: 91 commits

leafspark's picture

Upload DeepSeek-V2-Chat.iq3_xs.gguf/DeepSeek-V2-Chat.IQ3_XS-00006-of-00008.gguf with huggingface_hub

8ddd71a verified about 1 month ago

DeepSeek-V2-Chat.bf16.gguf
Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-22-of-22.gguf with huggingface_hub about 2 months ago
DeepSeek-V2-Chat.iq2_xxs.gguf
Upload DeepSeek-V2-Chat.iq2_xxs.gguf/DeepSeek-V2-Chat.IQ2_XXS-00003-of-00003.gguf with huggingface_hub about 2 months ago
DeepSeek-V2-Chat.iq3_xs.gguf
Upload DeepSeek-V2-Chat.iq3_xs.gguf/DeepSeek-V2-Chat.IQ3_XS-00006-of-00008.gguf with huggingface_hub about 1 month ago
DeepSeek-V2-Chat.q2_k.gguf
tool: add kv overrides to start command (win) about 2 months ago
DeepSeek-V2-Chat.q3_k_m.gguf
Add readme for q3_k_m about 2 months ago
DeepSeek-V2-Chat.q4_k_m.gguf
Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00006-of-00008.gguf with huggingface_hub about 2 months ago
DeepSeek-V2-Chat.q5_k_m.gguf
Create DeepSeek-V2-Chat.q5_k_m.gguf/readme.md about 2 months ago
DeepSeek-V2-Chat.q6_k.gguf
Create DeepSeek-V2-Chat.q6_k.gguf/readme.md about 2 months ago
DeepSeek-V2-Chat.q8_0.gguf
delete: Use gguf-split instead of Python script about 2 months ago
.gitattributes

6.35 kB

Upload DeepSeek-V2-Chat.iq3_xs.gguf/DeepSeek-V2-Chat.IQ3_XS-00006-of-00008.gguf with huggingface_hub about 1 month ago
README.md

3.68 kB

readme: add new llama.cpp release info about 1 month ago
imatrix.dat

456 MB
LFS

imatrix: add chunk 63 (final) about 2 months ago
llama.cpp-039896407afd40e54321d47c5063c46a52da3e01.zip

25.4 MB
LFS

build: add precompiled llama.cpp about 2 months ago