neuralmagic
/

Qwen2-72B-Instruct-quantized.w4a16

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qwen2-72B-Instruct-quantized.w4a16

2 contributors

History: 4 commits

abhinavnmagic's picture

Upload merges.txt with huggingface_hub

81f22da verified 6 months ago