GGUF
Not-For-All-Audiences
nsfw
Inference Endpoints

The biggest model merge yet?

#1
by iandennismiller - opened

This has to be one of the biggest merges I've ever seen. Congrats. You're pushing the envelope.

Did you run into any novel problems as you increased the number of models in the merge?

GGUF work fine, F16 work fine but I struggle to find how to make the exl2 work properly, output is now good on 2.4bpw
But I'm working on it, I used tools everyone use and I don't see why it wouldn't work on mine

Sign up or log in to comment