Hugging Face model: inference-optimization/sarvam-105b-FP8-Dynamic
Author: inference-optimization
Created: 2026-03-09 02:07:54
Last modified: 2026-03-09 15:00:12
Pipeline: text-generation
Likes: 0 | Downloads: 9
Tags: safetensors, sarvam_mla, fp8, vllm, text-generation, conversational, custom_code, base_model:sarvamai/sarvam-105b, base_model:quantized:sarvamai/sarvam-105b, compressed-tensors, region:us
Base model relation: quantized
Base models: id: sarvamai/sarvam-105b
Card metadata:
tags: fp8, vllm
pipeline_tag: text-generation
base_model: sarvamai/sarvam-105b