Update README.md
Browse files
README.md
CHANGED
@@ -803,7 +803,7 @@ Be sure to set the following environment variables:
|
|
803 |
| PUBLIC_KEY | `{paste your ssh public key}` |
|
804 |
| UI_ARGS | `--trust-remote-code` |
|
805 |
|
806 |
-
Access the webui via `http://{container IP address}:7860`, navigate to model, download jondurbin/bagel-20b-v04
|
807 |
|
808 |
- `use_flash_attention_2` should be checked
|
809 |
- set Model loader to Transformers
|
|
|
803 |
| PUBLIC_KEY | `{paste your ssh public key}` |
|
804 |
| UI_ARGS | `--trust-remote-code` |
|
805 |
|
806 |
+
Access the webui via `http://{container IP address}:7860`, navigate to model, download `jondurbin/bagel-20b-v04`, and ensure the following values are set:
|
807 |
|
808 |
- `use_flash_attention_2` should be checked
|
809 |
- set Model loader to Transformers
|