ISTA-DASLab

/

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

like 18

Hi! I know you're mostly doing foundation models right now. It would be great to have a clinical/bio model up, at some point.

I think https://huggingface.co/aaditya/Llama3-OpenBioLLM-70B is the current leader.

Thanks for making these quants, they've been super helpful!