Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
I've created a video tutorial how to run HuggingChat locally (VM)
#140
pinned
by
RobertoDonPedro
- opened
Hi, I've created a video tutorial for you on how to run HuggingChat locally (VM).
https://youtu.be/EchfCSv1iNM
In this video you learn how to run it in two variants.
Variant 1: Run just the Chat-UI locally and utilize the remote inference endpoint form HF
Variant 2: Run the whole stack, the Chat-UI, the Text Generation Inference Server and the (Open Assistent) LLM on your Virtual Machine
Feel free to use it to your needs @julien-c @coyotte508
coyotte508
pinned discussion
Hey
@RobertoDonPedro
Thanks for the video.
A doubt , approx how much VM configurations required to host a chat like this for maybe 1000 users accessing it in a minute.