leafspark
/

DeepSeek-V2-Chat-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

DeepSeek-V2-Chat-GGUF

1 contributor

History: 79 commits

leafspark's picture

Upload DeepSeek-V2-Chat.iq2_xxs.gguf/DeepSeek-V2-Chat.IQ2_XXS-00003-of-00003.gguf with huggingface_hub

04c1e99 verified about 2 months ago

DeepSeek-V2-Chat.bf16.gguf
Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-22-of-22.gguf with huggingface_hub about 2 months ago
DeepSeek-V2-Chat.iq2_xxs.gguf
Upload DeepSeek-V2-Chat.iq2_xxs.gguf/DeepSeek-V2-Chat.IQ2_XXS-00003-of-00003.gguf with huggingface_hub about 2 months ago
DeepSeek-V2-Chat.q2_k.gguf
tool: add kv overrides to start command (win) about 2 months ago
DeepSeek-V2-Chat.q3_k_m.gguf
Add readme for q3_k_m about 2 months ago
DeepSeek-V2-Chat.q4_k_m.gguf
Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00006-of-00008.gguf with huggingface_hub about 2 months ago
DeepSeek-V2-Chat.q5_k_m.gguf
Create DeepSeek-V2-Chat.q5_k_m.gguf/readme.md about 2 months ago
DeepSeek-V2-Chat.q6_k.gguf
Create DeepSeek-V2-Chat.q6_k.gguf/readme.md about 2 months ago
DeepSeek-V2-Chat.q8_0.gguf
delete: Use gguf-split instead of Python script about 2 months ago
.gitattributes

5.63 kB

Upload DeepSeek-V2-Chat.iq2_xxs.gguf/DeepSeek-V2-Chat.IQ2_XXS-00003-of-00003.gguf with huggingface_hub about 2 months ago
README.md

3.61 kB

readme: TODO implement llamafile about 2 months ago
imatrix.dat

456 MB
LFS

imatrix: add chunk 63 (final) about 2 months ago
llama.cpp-039896407afd40e54321d47c5063c46a52da3e01.zip

25.4 MB
LFS

build: add precompiled llama.cpp about 2 months ago