Model: MikeKuykendall/gpt-oss-20b-moe-cpu-offload-gguf
Author: MikeKuykendall
Pipeline: text-generation
Library: llama.cpp
Tags: llama.cpp, safetensors, gguf, mixture-of-experts, moe, cpu-offload, shimmy, memory-efficient, first-implementation, text-generation, en, multilingual, license:apache-2.0, model-index, endpoints_compatible, region:us, conversational
Card metadata: license: apache-2.0
base_model: WeOpenML/GPT-OSS-20B
tags: mixture-of-experts, moe, cpu-offload, gguf, llama.cpp, shimmy, memory-efficient, first-implementation
library_name: llama.cpp
model_type: gpt-oss
quantized_by: MikeKuykendall
language: en, multilingual
pipeline_tag: text-generation
widget: text: Write a Python function for fibonacci sequence
example_title: Code Generation, text: Explain quantum computing in simple terms
example_title: Explanation Task
model-index: name: gpt-oss-20b-moe-cpu-offload-gguf
results: task: type: text-generation
dataset: type: cpu-offload-benchmark
name: MoE CPU Offloading (First Implementation)
metrics: type: vram_reduction
value: 99.9
name: VRAM Reduction %
verified: no, type: memory_usage_mb
value: 2
name: GPU Memory Usage (MB)
verified: no
Likes: 2 | All-time downloads: 614
Created: 2025-10-06 18:23:41