doberst113080
commited on
Commit
•
cadf091
1
Parent(s):
3b6d974
Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ Load in your favorite GGUF inference engine, or try with llmware as follows:
|
|
20 |
|
21 |
from llmware.models import ModelCatalog
|
22 |
model = ModelCatalog().load_model("llmware/bling-stablelm-3b-gguf")
|
23 |
-
response = model.inference(query, add_context=text_sample)
|
24 |
|
25 |
Note: please review [**config.json**](https://huggingface.co/llmware/bling-stablelm-3b-gguf/blob/main/config.json) in the repository for prompt wrapping information, details on the model, and full test set.
|
26 |
|
|
|
20 |
|
21 |
from llmware.models import ModelCatalog
|
22 |
model = ModelCatalog().load_model("llmware/bling-stablelm-3b-gguf")
|
23 |
+
response = model.inference(query, add_context=text_sample, add_prompt_engineering="default_with_context")
|
24 |
|
25 |
Note: please review [**config.json**](https://huggingface.co/llmware/bling-stablelm-3b-gguf/blob/main/config.json) in the repository for prompt wrapping information, details on the model, and full test set.
|
26 |
|