Hugging Face model: MikeKuykendall/phi-3.5-moe-cpu-offload-gguf
Author: MikeKuykendall
Created: 2025-10-06 18:55:42
Last modified: 2025-10-08 22:58:46
Pipeline: text-generation
Library: llama.cpp
Likes: 0 | Downloads: 12
Tags: llama.cpp, gguf, moe, mixture-of-experts, shimmy, rust, cpu-offload, text-generation, multilingual, arxiv:2404.14219, base_model:microsoft/Phi-3.5-MoE-instruct, base_model:quantized:microsoft/Phi-3.5-MoE-instruct, license:mit, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: microsoft/Phi-3.5-MoE-instruct
Card metadata:
license: mit
license_link: https://huggingface.co/microsoft/Phi-3.5-MoE-instruct/resolve/main/LICENSE
base_model: microsoft/Phi-3.5-MoE-instruct
tags: moe, mixture-of-experts, gguf, llama.cpp, shimmy, rust, cpu-offload
quantized_by: MikeKuykendall
language: multilingual
pipeline_tag: text-generation
library_name: llama.cpp