Quants that run fast on single 3090/4090 card with 24GB of VRAM and 4096 context length
-
TeeZee/2xbagel-dpo-34b-v0.2-bpw3.0-h6-exl2
Text Generation • Updated • 19 • 1 -
TeeZee/2xNous-Capybara-34B-bpw3-h6-exl2
Text Generation • Updated • 20 -
TeeZee/Psyfighter2-Orca2-13B-ties-bpw8.0-h8-exl2
Text Generation • Updated • 21 -
TeeZee/chronomaid-storytelling-13B-bpw8.0-h8-exl2
Text Generation • Updated • 22