Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
leafspark
/
DeepSeek-V2-Chat-GGUF
like
22
Text Generation
Transformers
GGUF
English
Chinese
code
deepseek
bf16
Inference Endpoints
License:
mit
Model card
Files
Files and versions
Community
6
Train
Deploy
Use this model
30dc34b
DeepSeek-V2-Chat-GGUF
1 contributor
History:
95 commits
leafspark
Upload DeepSeek-V2-Chat.q8_0.gguf/DeepSeek-V2-Chat.Q8_0-00001-of-00012.gguf with huggingface_hub
30dc34b
verified
2 months ago
DeepSeek-V2-Chat.bf16.gguf
Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-22-of-22.gguf with huggingface_hub
3 months ago
DeepSeek-V2-Chat.iq2_xxs.gguf
Upload DeepSeek-V2-Chat.iq2_xxs.gguf/DeepSeek-V2-Chat.IQ2_XXS-00003-of-00003.gguf with huggingface_hub
3 months ago
DeepSeek-V2-Chat.iq3_xs.gguf
Upload DeepSeek-V2-Chat.iq3_xs.gguf/DeepSeek-V2-Chat.IQ3_XS-00008-of-00008.gguf with huggingface_hub
2 months ago
DeepSeek-V2-Chat.q2_k.gguf
tool: add kv overrides to start command (win)
3 months ago
DeepSeek-V2-Chat.q3_k_m.gguf
Add readme for q3_k_m
3 months ago
DeepSeek-V2-Chat.q4_k_m.gguf
Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00006-of-00008.gguf with huggingface_hub
3 months ago
DeepSeek-V2-Chat.q5_k_m.gguf
Create DeepSeek-V2-Chat.q5_k_m.gguf/readme.md
3 months ago
DeepSeek-V2-Chat.q6_k.gguf
Create DeepSeek-V2-Chat.q6_k.gguf/readme.md
3 months ago
DeepSeek-V2-Chat.q8_0.gguf
Upload DeepSeek-V2-Chat.q8_0.gguf/DeepSeek-V2-Chat.Q8_0-00001-of-00012.gguf with huggingface_hub
2 months ago
.gitattributes
6.67 kB
Upload DeepSeek-V2-Chat.q8_0.gguf/DeepSeek-V2-Chat.Q8_0-00001-of-00012.gguf with huggingface_hub
2 months ago
README.md
3.68 kB
readme: fix kv overrides
2 months ago
imatrix.dat
456 MB
LFS
imatrix: add chunk 63 (final)
3 months ago
llama.cpp-039896407afd40e54321d47c5063c46a52da3e01.zip
pickle
25.4 MB
LFS
build: add precompiled llama.cpp
3 months ago
