Expanding GGUF Versions: Bean, OmegLlama, and More in OpenLlama and StableLM (gguf) Collections

#4
by maddes8cht - opened

Hello Bohan Du,

I wanted to express my appreciation for your work on fine-tuning the OpenLlama and stableLM models. I've converted all of them (that are convertible) to the llama.cpp native .gguf file format, with most conversions completed even before the Bloke did them. Notably, I've included the OmegLlama and Bean models, which are currently missing on theBloke's side.

I recently noticed that you've linked back to "theBloke's" converted versions of your models on Hugging Face - but at least the OmegLlama and Bean models are still missing, so maybe you like to include backlinks to .gguf versions of them too, so mine are here: OmegLlama-3b-gguf and Bean-3b.
There are also my collections of StableLM and of OpenLlama models, all converted to gguf, and including your models.

Note that my focus is on models with genuinely free licenses (no "pseudo-OpenSource" as in Metas License ), and I'm committed to fostering a culture of open source in the AI community. I understand that theBloke has also done commendable work, and I'm not here to compete but to contribute collectively to the availability of models under real open-source licenses.

If you have any feedback, suggestions, or if there's a specific model you'd like to see converted into gguf format, please feel free to let me know.

Best regards

Mathias Bachmann alias maddes8cht

Thank you so much! I really appreciate it.

acrastt changed discussion status to closed

Hello Bohan Du,

I wanted to express my appreciation for your work on fine-tuning the OpenLlama and stableLM models. I've converted all of them (that are convertible) to the llama.cpp native .gguf file format, with most conversions completed even before the Bloke did them. Notably, I've included the OmegLlama and Bean models, which are currently missing on theBloke's side.

I recently noticed that you've linked back to "theBloke's" converted versions of your models on Hugging Face - but at least the OmegLlama and Bean models are still missing, so maybe you like to include backlinks to .gguf versions of them too, so mine are here: OmegLlama-3b-gguf and Bean-3b.
There are also my collections of StableLM and of OpenLlama models, all converted to gguf, and including your models.

Note that my focus is on models with genuinely free licenses (no "pseudo-OpenSource" as in Metas License ), and I'm committed to fostering a culture of open source in the AI community. I understand that theBloke has also done commendable work, and I'm not here to compete but to contribute collectively to the availability of models under real open-source licenses.

If you have any feedback, suggestions, or if there's a specific model you'd like to see converted into gguf format, please feel free to let me know.

Best regards

Mathias Bachmann alias maddes8cht

thanks for the quants, I'm doing some 3b merges, if you have some time here another:
https://huggingface.co/Aryanne/Astridboros-3B

Sign up or log in to comment