Hugging Face model: mratsim/Seed-OSS-36B-Instruct-FP8-KV8
Author: mratsim
Created: 2025-10-19 14:29:24
Last modified: 2025-10-19 14:54:35
Pipeline: text-generation
Likes: 1 | Downloads: 4
Tags: safetensors, seed_oss, vllm, llmcompressor, text-generation-inference, text-generation, conversational, dataset:HuggingFaceH4/ultrachat_200k, base_model:ByteDance-Seed/Seed-OSS-36B-Instruct, base_model:quantized:ByteDance-Seed/Seed-OSS-36B-Instruct, license:mit, compressed-tensors, region:us
Base model relation: quantized
Base models: id: ByteDance-Seed/Seed-OSS-36B-Instruct
Card metadata:
license: mit
base_model: ByteDance-Seed/Seed-OSS-36B-Instruct
datasets: HuggingFaceH4/ultrachat_200k
pipeline_tag: text-generation
tags: vllm, llmcompressor, text-generation-inference