Hugging Face model: AMbaye018/sarvam-30b-AWQ-then-FP8
Author: AMbaye018
Created: 2026-04-22 09:14:24
Last modified: 2026-04-22 09:17:09
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 9
Tags: transformers, safetensors, sarvam_moe, text-generation, quantized, awq, fp8, mixed-precision, 4-bit, 8-bit, llm-compressor, vllm, moe, resilient-ai-challenge, conversational, custom_code, en, hi, bn, ta, te, mr, gu, kn, ml, pa, or, as, ur, ne, sa, sd, ks, doi, kok, mai, mni, sat, brx, base_model:sarvamai/sarvam-30b, base_model:quantized:sarvamai/sarvam-30b, license:apache-2.0, compressed-tensors, region:us
Base model relation: quantized
Base models: id: sarvamai/sarvam-30b
Card metadata:
license: apache-2.0
base_model: sarvamai/sarvam-30b
tags: quantized, awq, fp8, mixed-precision, 4-bit, 8-bit, llm-compressor, vllm, moe, resilient-ai-challenge
language: en, hi, bn, ta, te, mr, gu, kn, ml, pa, or, as, ur, ne, sa, sd, ks, doi, kok, mai, mni, sat, brx
library_name: transformers
pipeline_tag: text-generation