Hugging Face model: RedHatAI/sarvam-30b-FP8-dynamic
Author: RedHatAI
Created: 2026-03-09 15:13:11
Last modified: 2026-04-28 22:13:17
Pipeline: text-generation
Likes: 1 | Downloads: 134
Tags: safetensors, sarvam_moe, fp8, vllm, text-generation, conversational, custom_code, en, hi, bn, ta, te, mr, gu, kn, ml, pa, or, as, ur, sa, ne, sd, kok, mai, doi, mni, sat, ks, bo, base_model:sarvamai/sarvam-30b, base_model:quantized:sarvamai/sarvam-30b, license:apache-2.0, compressed-tensors, region:us
Base model relation: quantized
Base models: id: sarvamai/sarvam-30b
Card metadata:
tags: fp8, vllm
pipeline_tag: text-generation
provider: Sarvam AI
license: apache-2.0
license_name: apache-2.0
name: RedHatAI/sarvam-30b-FP8-dynamic
license_link: https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md
readme: https://huggingface.co/RedHatAI/sarvam-30b-FP8-dynamic/blob/main/README.md
description: Sarvam-30B is an advanced Mixture-of-Experts (MoE) model with 2.4B non-embedding active parameters, designed primarily for practical deployment. It combines strong reasoning, reliable coding ability, and best-in-class conversational quality across Indian languages. Sarvam-30B is built to run reliably in resource-constrained environments and can handle multilingual voice calls while performing tool calls.
base_model: sarvamai/sarvam-30b
validated_on: RHOAI 3.4, RHAIIS 3.4, vLLM 0.18.0
language: en, hi, bn, ta, te, mr, gu, kn, ml, pa, or, as, ur, sa, ne, sd, kok, mai, doi, mni, sat, ks, bo