GGUF Version? =)

#1
by SimSim93 - opened

@TheBloke

This seems to be the best 7b model right now. It would be awesome if you could provide everybode with a gguf version of this model! =)

By the way: Thank you for your work!

And of course thank you to @fblgit for providing this awesome version of mistral! =)

hehe my pleasure. and yeah thanks @TheBloke and @bartowski for their gigantic contribution to the community.
looking forward to see this one on llm studio main page card :D

Starting the quant now :D thank you uploading safetensors, always appreciated ;)

files will appear here as they're ready: https://huggingface.co/bartowski/una-cybertron-7b-v2-exl2

I'd like to test this on a small dataset of prices of a 2nd hand good market and see how much analytical extrapolation can be done with it w/ a GGUF version :)

thanks everyone, Q & GG versions are out already. closing this.

fblgit changed discussion status to closed

Sign up or log in to comment