Obsidian llamafile?
#2
by
KatyKunXD
- opened
Would you be able to make a single llamafile of NousResearch/Obsidian-3B-V0.5, like the llava 1.5 server model? Thank you for creating this!
You're able to do it. See https://github.com/mozilla-Ocho/llamafile#source-instructions for instructions on how you can create your own llamafiles. It'd be nice to see other people posting their own llamafiles on Hugging Face. If you do it, then I recommend that you document what llamafile release or git sha you're using for the binary content. It's also a good idea to include the cosmocc --version. That way, anyone who needs to, will be able to reproduce your builds.
jartine
changed discussion status to
closed