Anmol Reddy's picture

4 1

Anmol Reddy

molereddy

·

AI & ML interests

Speech recognition

Recent Activity

liked a dataset about 2 months ago

locuslab/TOFU

updated a model about 2 months ago

open-unlearning/tofu_Llama-2-7b-chat-hf_retain99

updated a model about 2 months ago

open-unlearning/tofu_Llama-3.1-8B-Instruct_retain95

View all activity

Organizations

molereddy's activity

New activity in RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 5 months ago

Poorer performance than W8A8

#6 opened 5 months ago by

New activity in CalamitousFelicitousness/Qwen2.5-0.5B-Instruct-fp8-dynamic 5 months ago

How was the quantization performed - do you have a recipe?

#1 opened 5 months ago by

New activity in RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 5 months ago

Is this the standard GPTQ quantization?

#5 opened 5 months ago by

New activity in RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 5 months ago

Model weights are not loaded

#3 opened 8 months ago by