Hugging Face model: MikeKuykendall/deepseek-moe-16b-cpu-offload-gguf
Author: MikeKuykendall
Created: 2025-10-06 19:52:45
Last modified: 2025-10-08 22:58:49
Pipeline: text-generation
Library: llama.cpp
Likes: 0 | Downloads: 17
Tags: llama.cpp, gguf, moe, mixture-of-experts, shimmy, rust, cpu-offload, text-generation, en, zh, arxiv:2401.06066, base_model:deepseek-ai/deepseek-moe-16b-base, base_model:quantized:deepseek-ai/deepseek-moe-16b-base, license:apache-2.0, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: deepseek-ai/deepseek-moe-16b-base
Card metadata:
license: apache-2.0
license_link: https://huggingface.co/deepseek-ai/deepseek-moe-16b-base/blob/main/LICENSE
base_model: deepseek-ai/deepseek-moe-16b-base
tags: moe, mixture-of-experts, gguf, llama.cpp, shimmy, rust, cpu-offload
quantized_by: MikeKuykendall
language: en, zh
pipeline_tag: text-generation
library_name: llama.cpp