Hugging Face model: amir22010/sarvam-30b-gptq-4bit
Author: amir22010
Created: 2026-05-02 23:10:02
Last modified: 2026-06-15 12:51:08
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, safetensors, sarvam_moe, text-generation, gptq, quantization, llm-compressor, 4-bit, indic, moe, conversational, custom_code, hi, en, base_model:sarvamai/sarvam-30b, base_model:quantized:sarvamai/sarvam-30b, license:apache-2.0, compressed-tensors, region:us
Base model relation: quantized
Base models: id: sarvamai/sarvam-30b
Card metadata:
language: hi, en
license: apache-2.0
library_name: transformers
tags: gptq, quantization, llm-compressor, 4-bit, indic, moe
base_model: sarvamai/sarvam-30b
model_creator: sarvamai
model_name: sarvam-30b-gptq-4bit
quantized_by: amir22010
quantization_config: quant_method: gptq
bits: 4
scheme: W4A16
group_size: 128
block_size: 128
damp_percent: 0.1
desc_act: yes
sequential_update: yes
sym: yes
target_modules: Linear
ignore_modules: lm_head, re:.*gate.*
dataset: name: LinguaLift/IndicMMLU-Pro
split: validation
subset: hindi
num_samples: 512
max_sequence_length: 2048