Commit
·
8fa68e8
1
Parent(s):
9be5ab5
🔧 Document .env more
Browse files
.env
CHANGED
|
@@ -14,6 +14,6 @@ PUBLIC_USER_MESSAGE_TOKEN=<|prompter|>
|
|
| 14 |
PUBLIC_ASSISTANT_MESSAGE_TOKEN=<|assistant|>
|
| 15 |
PUBLIC_SEP_TOKEN=<|endoftext|>
|
| 16 |
|
| 17 |
-
#
|
| 18 |
# Eg if one endpoint has weight 2 and the other has weight 1, the first endpoint will be called twice as often
|
| 19 |
MODEL_ENDPOINTS=`[]`
|
|
|
|
| 14 |
PUBLIC_ASSISTANT_MESSAGE_TOKEN=<|assistant|>
|
| 15 |
PUBLIC_SEP_TOKEN=<|endoftext|>
|
| 16 |
|
| 17 |
+
# [{"endpoint": "https://api-inference.huggingface.co/models/...", authorization: "Bearer hf_<token>", weight: 1}] to load balance
|
| 18 |
# Eg if one endpoint has weight 2 and the other has weight 1, the first endpoint will be called twice as often
|
| 19 |
MODEL_ENDPOINTS=`[]`
|