Obsidian llamafile?

#2
by KatyKunXD - opened

Would you be able to make a single llamafile of NousResearch/Obsidian-3B-V0.5, like the llava 1.5 server model? Thank you for creating this!

You're able to do it. See https://github.com/mozilla-Ocho/llamafile#source-instructions for instructions on how you can create your own llamafiles. It'd be nice to see other people posting their own llamafiles on Hugging Face. If you do it, then I recommend that you document what llamafile release or git sha you're using for the binary content. It's also a good idea to include the cosmocc --version. That way, anyone who needs to, will be able to reproduce your builds.

jartine changed discussion status to closed

Sign up or log in to comment