AminBH/Llama-3-8B-Quarot-wiki-4bit
Text Generation • 8B • Updated • 9
Edit Models filters
Tasks
Parameters
Inference Providers
Hardware
Models
14
AminBH/Llama-3-8B-Quarot-wiki-8bit
Text Generation • 8B • Updated • 9
HangGuo/Llama2-70B-QuaRot-OBR-GPTQ-W4A4KV4S50
Text Generation • Updated • 8 • 1
HangGuo/Llama2-70B-QuaRot-OBR-RTN-W4A4KV4S50
Text Generation • Updated • 3
HangGuo/Llama2-7B-QuaRot-OBR-GPTQ-W4A4KV4S50
Text Generation • Updated • 3
HangGuo/Llama3-70B-QuaRot-OBR-RTN-W4A4KV16S50
Text Generation • Updated • 2
HangGuo/Llama3-70B-QuaRot-OBR-GPTQ-W4A4KV16S50
Text Generation • Updated • 10
Chandanv1989/Qwen3-30B-A3B-w8a8-QuaRot-310
Updated
cymic/llama2-13b-quarot-w3
13B • Updated • 5
cymic/llama2-13b-quarot-w4
13B • Updated • 5
cymic/llama2-13b-quarot-w8
13B • Updated • 7
cymic/llama2-7b-quarot-w3
7B • Updated • 7
cymic/llama2-7b-quarot-w4
7B • Updated • 6
cymic/llama2-7b-quarot-w8
7B • Updated • 5