cortecs
/

Meta-Llama-3-70B-Instruct-GPTQ-8b

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Update to Llama 3.1

#2

by kuliev-vitaly - opened Jul 27

Jul 27

The model is better in comparison with 4bit quants! Please make another quant of 3.1 llama 70b.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment