27 3 88

Yunus Manti

Yuma42

AI & ML interests

I'm generating and running AI to experiment and educate myself.

Recent Activity

liked a model 19 days ago

bartowski/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base-GGUF

Reacted to bartowski's post with 👍 19 days ago

In regards to the latest mistral model and GGUFs for it: Yes, they may be subpar and may require changes to llama.cpp to support the interleaved sliding window Yes, I got excited when a conversion worked and released them ASAP That said, generation seems to work right now and seems to mimic the output from spaces that are running the original model I have appended -TEST to the model names in an attempt to indicate that they are not final or perfect, but if people still feel mislead and that it's not the right thing to do, please post (civilly) below your thoughts, I will highly consider pulling the conversions if that's what people think is best. After all, that's what I'm here for, in service to you all !

New activity 20 days ago

Joseph717171/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base:Q4_0_4_4 gguf

View all activity

Organizations

None yet

Yuma42's activity

liked a model 19 days ago

bartowski/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base-GGUF

Text Generation • Updated 19 days ago • 1.19k • 2

Reacted to bartowski's post with 👍 19 days ago

Post

16764

In regards to the latest mistral model and GGUFs for it:

Yes, they may be subpar and may require changes to llama.cpp to support the interleaved sliding window

Yes, I got excited when a conversion worked and released them ASAP

That said, generation seems to work right now and seems to mimic the output from spaces that are running the original model

I have appended -TEST to the model names in an attempt to indicate that they are not final or perfect, but if people still feel mislead and that it's not the right thing to do, please post (civilly) below your thoughts, I will highly consider pulling the conversions if that's what people think is best. After all, that's what I'm here for, in service to you all !