Model: mratsim/Seed-OSS-36B-Instruct-FP8-KV8
Author: mratsim
Pipeline: text-generation
Tags: safetensors, seed_oss, vllm, llmcompressor, text-generation-inference, text-generation, conversational, dataset:HuggingFaceH4/ultrachat_200k, base_model:ByteDance-Seed/Seed-OSS-36B-Instruct, base_model:quantized:ByteDance-Seed/Seed-OSS-36B-Instruct, license:mit, compressed-tensors, region:us
Base models (quantized): id: ByteDance-Seed/Seed-OSS-36B-Instruct
Card metadata: license: mit
base_model: ByteDance-Seed/Seed-OSS-36B-Instruct
datasets: HuggingFaceH4/ultrachat_200k
pipeline_tag: text-generation
tags: vllm, llmcompressor, text-generation-inference
Likes: 1 | All-time downloads: 123
Created: 2025-10-19 14:29:24