Upload Deepseek-V2-Chat.IQ1_M.gguf with huggingface_hub

readme: update quants

Upload DeepSeek-V2-Chat.iq2_xxs.gguf/DeepSeek-V2-Chat.IQ2_XXS-00003-of-00003.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.iq2_xxs.gguf/DeepSeek-V2-Chat.IQ2_XXS-00002-of-00003.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.iq2_xxs.gguf/DeepSeek-V2-Chat.IQ2_XXS-00001-of-00003.gguf with huggingface_hub

tool: add kv overrides to start command (win)

tool: add linux autorun (no CUDA, ubuntu)

tool: automatically download llama.cpp and model files; run chat completions server (win, cuda)

readme: TODO implement llamafile

readme: add quants update

Upload DeepSeek-V2-Chat.q2_k.gguf/DeepSeek-V2-Chat.Q2_K-00005-of-00005.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.q2_k.gguf/DeepSeek-V2-Chat.Q2_K-00004-of-00005.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.q2_k.gguf/DeepSeek-V2-Chat.Q2_K-00003-of-00005.gguf with huggingface_hub

imatrix: add chunk 63 (final)

Upload DeepSeek-V2-Chat.q2_k.gguf/DeepSeek-V2-Chat.Q2_K-00002-of-00005.gguf with huggingface_hub

imatrix: add chunk 13

Upload DeepSeek-V2-Chat.q2_k.gguf/DeepSeek-V2-Chat.Q2_K-00001-of-00005.gguf with huggingface_hub

imatrix: update after 6 chunks

imatrix: update after 4 chunks

readme: add detailed instructions

imatrix: upload 3 chunks

build: add precompiled llama.cpp

Upload imatrix.dat

Update README.md

delete: Use gguf-split instead of Python script

Create readme.md

Create DeepSeek-V2-Chat.q6_k.gguf/readme.md

Create DeepSeek-V2-Chat.q5_k_m.gguf/readme.md

Add readme for q3_k_m

Update README.md

Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-22-of-22.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-21-of-22.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-20-of-22.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00006-of-00008.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00007-of-00008.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00008-of-00008.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00005-of-00008.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00004-of-00008.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00003-of-00008.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00002-of-00008.gguf with huggingface_hub

Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00001-of-00008.gguf with huggingface_hub

Rename Deepseek-V2-Chat.q8_0.gguf/merge.py to DeepSeek-V2-Chat.q8_0.gguf/merge.py

Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-19-of-22.gguf with huggingface_hub

Update README.md

Use bf16 instead

Update DeepSeek-V2-Chat.q2_k.gguf/readme.md

Create DeepSeek-V2-Chat.q2_k.gguf/readme.md

Rename Deepseek-V2-Chat.Q4_K_M.gguf/readme.md to DeepSeek-V2-Chat.q4_k_m.gguf/readme.md

Rename Deepseek-V2-Chat.f16.gguf/merge.py to Deepseek-V2-Chat.Q4_K_M.gguf/readme.md

Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-18-of-22.gguf with huggingface_hub