Model: 2imi9/gpt-oss-20B-NVFP4A16-BF16
Author: 2imi9
Pipeline: text-generation
Tags: safetensors, gpt_oss, fp4, nvfp4, quantized, vllm, text-generation, post-training-quantization, conversational, en, dataset:openai/gpt-oss-training-data, base_model:openai/gpt-oss-20b, base_model:quantized:openai/gpt-oss-20b, license:apache-2.0, model-index, region:us
Base models (quantized): id: openai/gpt-oss-20b
Card metadata: tags: fp4, nvfp4, quantized, vllm, text-generation, post-training-quantization
language: en
pipeline_tag: text-generation
license: apache-2.0
base_model: openai/gpt-oss-20b
base_model_relation: quantized
model_type: quantized
quantization_config: bits: 4
method: nvidia_tensorrt_model_optimizer
format: NVFP4
config: NVFP4_DEFAULT_CFG
library: modelopt
precision: W4A16
datasets: openai/gpt-oss-training-data
model-index: name: gpt-oss-20b-nvfp4
results: task: type: text-generation
name: Text Generation
metrics: type: accuracy
name: Accuracy Retention vs MXFP4
value: 2-3% improvement
verified: no
Likes: 2 | All-time downloads: 7185
Created: 2025-08-31 03:27:56