can i request 8bpw?

#1
by Perpetuity7 - opened

i can use 70b 8bpw models using 4x 3090, 96GB VRAM

Owner

Of course.
Here you go

Sign up or log in to comment