Ollama compatible model release via GGUF ?
#9
by
kodis-rz
- opened
Hi all,
Is there any possibility of providing a ollama compatible version (i.e. GGUF files) of the models?
This would allow the Teuken 7B to be used for other applications.
Of course we can convert it ourselves but would appreciate any kind of feedback on it.
Thanks.
Richard
Hello Richard,
there are already a few ollama compatible versions available from the community: https://huggingface.co/models?other=base_model:quantized:openGPT-X/Teuken-7B-instruct-research-v0.4
We are also working on an "official" GGUF, but need a few more days to properly test it.
Michael
barthfab
changed discussion status to
closed