GGML demo

#6
by matthoffner - opened

I've put together a demo using a quantized ggml version from @TheBloke running on a CPU upgrade space:

API: https://huggingface.co/spaces/matthoffner/starchat-ggml
UI: https://huggingface.co/spaces/matthoffner/starchat-ui

Hugging Face H4 org

Awesome work @matthoffner !!

Very nice!I have linked them in the README of my GGML repo

image.png

Thanks @TheBloke @lewtun !

matthoffner changed discussion status to closed

i am getting errors when trying to build https://huggingface.co/spaces/matthoffner/starchat-ggml

Sign up or log in to comment