Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Run it locally with same UI ?
#138
by
Daciansolgen9
- opened
Hi! I would like to know if it's possible to install hugging chat and star coder and run it locally within my Local network and have the same UI as hugging chat uses? Is there any tutorials on how to get it locally with UI?
You can run it locally as it based on https://huggingface.co/OpenAssistant/oasst-sft-6-llama-30b-xor
This is a huggingface space wo you can run it locally just by cloning it and installing all the dependencies. https://huggingface.co/spaces/huggingchat/chat-ui
Also make sure you have the proper hardware to run this.
Hi
@Daciansolgen9
, maybe this will it help you (although it does not cover star coder explicitely)
Running HuggingChat locally (VM) | Chat-UI + Inference Server + LLM https://youtu.be/EchfCSv1iNM