Hugging Face model: RedHatAI/sarvam-105b-FP8-dynamic
Author: RedHatAI
Created: 2026-03-09 15:14:10
Last modified: 2026-04-28 22:12:59
Pipeline: text-generation
Likes: 3 | Downloads: 31
Tags: safetensors, sarvam_mla, fp8, vllm, text-generation, conversational, custom_code, en, hi, bn, ta, te, mr, gu, kn, ml, pa, or, as, ur, sa, ne, sd, kok, mai, doi, mni, sat, ks, bo, base_model:sarvamai/sarvam-105b, base_model:quantized:sarvamai/sarvam-105b, license:apache-2.0, compressed-tensors, region:us
Base model relation: quantized
Base models: id: sarvamai/sarvam-105b
Card metadata:
tags: fp8, vllm
pipeline_tag: text-generation
provider: Sarvam AI
license: apache-2.0
license_name: apache-2.0
name: RedHatAI/sarvam-105b-FP8-dynamic
license_link: https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md
readme: https://huggingface.co/RedHatAI/sarvam-105b-FP8-dynamic/blob/main/README.md
description: Sarvam-105B is an advanced Mixture-of-Experts (MoE) model with 10.3B active parameters, designed for superior performance across a wide range of complex tasks. It is highly optimized for complex reasoning, with particular strength in agentic tasks, mathematics, and coding.
base_model: sarvamai/sarvam-105b
validated_on: RHOAI 3.4, RHAIIS 3.4, vLLM 0.18.0
language: en, hi, bn, ta, te, mr, gu, kn, ml, pa, or, as, ur, sa, ne, sd, kok, mai, doi, mni, sat, ks, bo