Text Generation
Transformers
Safetensors
llama
conversational
Eval Results
Inference Endpoints
text-generation-inference

Can you quantify this model?

#1
by xldistance - opened
One-Man-Army org

@TheBloke @bartowski can you guys give a hand please ? If u guys are pack, i can quant it and upload to ur repos

It's in my queue, so in a couple hours.

Edit: quants will start appearing here over the next hour or so:
https://huggingface.co/models?search=LoneStriker%20UNA-34Beagles-32K-bf16-v1

Thanks for sharing this model, I released a GPTQ version of it if anyone needs it: https://huggingface.co/MaziyarPanahi/UNA-34Beagles-32K-bf16-v1-GPTQ

One-Man-Army org

its like the search engine doesnt like Beagles :D

One-Man-Army org

its like the search engine doesnt like Beagles :D

I think its just how huggingface search works, 34beagles comes up with results but beagles doesn't

Sign up or log in to comment