coyotte508 HF staff commited on
Commit
07a1e01
β€’
1 Parent(s): 6f38e99

πŸ“ Better documentation for MODEL_ENDPOINTS

Browse files
Files changed (1) hide show
  1. .env +8 -3
.env CHANGED
@@ -16,6 +16,11 @@ PUBLIC_SEP_TOKEN=</s>
16
  PUBLIC_PREPROMPT="Below are a series of dialogues between various people and an AI assistant. The AI tries to be helpful, polite, honest, sophisticated, emotionally aware, and humble-but-knowledgeable. The assistant is happy to help with almost anything, and will do its best to understand exactly what is needed. It also tries to avoid giving false or misleading information, and it caveats when it isn't entirely sure about the right answer. That said, the assistant is practical and really does its best, and doesn't let caution get too much in the way of being useful."
17
  PUBLIC_VERSION=0
18
  PUBLIC_GOOGLE_ANALYTICS_ID=#G-XXXXXXXX / Leave empty to disable
19
- # [{"endpoint": "https://api-inference.huggingface.co/models/...", "authorization": "Bearer hf_<token>", "weight": 1}] to load balance
20
- # Eg if one endpoint has weight 2 and the other has weight 1, the first endpoint will be called twice as often
21
- MODEL_ENDPOINTS=`[]`
 
 
 
 
 
 
16
  PUBLIC_PREPROMPT="Below are a series of dialogues between various people and an AI assistant. The AI tries to be helpful, polite, honest, sophisticated, emotionally aware, and humble-but-knowledgeable. The assistant is happy to help with almost anything, and will do its best to understand exactly what is needed. It also tries to avoid giving false or misleading information, and it caveats when it isn't entirely sure about the right answer. That said, the assistant is practical and really does its best, and doesn't let caution get too much in the way of being useful."
17
  PUBLIC_VERSION=0
18
  PUBLIC_GOOGLE_ANALYTICS_ID=#G-XXXXXXXX / Leave empty to disable
19
+
20
+ # Copy this in .env.local with and replace "hf_<token>" your HF token from https://huggingface.co/settings/token
21
+ # You can also change the model from OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5 to your own model
22
+ MODEL_ENDPOINTS=`[{
23
+ "endpoint": "https://api-inference.huggingface.co/models/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5",
24
+ "authorization": "Bearer hf_<token>",
25
+ "weight": 1
26
+ }]`