latimar
/

Synthia-13B-exl2

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Can you quantize MythoMax

#1

by TheYuriLover - opened Sep 15, 2023

Sep 15, 2023

This one deserves a 4.625 and 5.0 bpw quant :D

latimar

Owner Sep 21, 2023

There are already EXL2 quants of MythoMax: https://huggingface.co/QMB15/mythomax-13B-8.13bit-MAX-exl2 , https://huggingface.co/QMB15/mythomax-L2-13B-4.625bit-exl2

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment