LoneStriker
/

Meta-Llama-3-70B-Instruct-2.25bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Can we get 2 bpw for 24gb cards?

#2

by MrHillsss - opened Apr 25

Apr 25

.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment