neuralmagic-ent/Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
2
Llama 3.1 Quantized
-
-
neuralmagic-ent/Llama-3.1-70B-quantized.w8a8
Updated • 2 -
neuralmagic-ent/Llama-3.1-8B-Instruct-FP8-dynamic
Text Generation • Updated • 309 -
neuralmagic-ent/Llama-3.1-70B-Instruct-quantized.w8a8
Text Generation • Updated • 4 -
neuralmagic-ent/Llama-3.1-8B-Instruct-quantized.w4a16
Text Generation • Updated • 2 -
neuralmagic-ent/Llama-3.1-8B-quantized.w8a8
Text Generation • Updated • 2 -
neuralmagic-ent/Llama-3.1-405B-Instruct-quantized.w8a8
Text Generation • Updated • 12 -
neuralmagic-ent/Llama-3.1-70B-Instruct-FP8-dynamic
Text Generation • Updated • 46 -
neuralmagic-ent/Llama-3.1-70B-Instruct-quantized.w4a16
Text Generation • Updated • 7 -
neuralmagic-ent/Llama-3.1-405B-Instruct-quantized.w4a16
Text Generation • Updated • 11 -
neuralmagic-ent/Llama-3.1-405B-Instruct-FP8-dynamic
Text Generation • Updated • 16