doberst113080 commited on
Commit
cadf091
1 Parent(s): 3b6d974

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -20,7 +20,7 @@ Load in your favorite GGUF inference engine, or try with llmware as follows:
20
 
21
  from llmware.models import ModelCatalog
22
  model = ModelCatalog().load_model("llmware/bling-stablelm-3b-gguf")
23
- response = model.inference(query, add_context=text_sample)
24
 
25
  Note: please review [**config.json**](https://huggingface.co/llmware/bling-stablelm-3b-gguf/blob/main/config.json) in the repository for prompt wrapping information, details on the model, and full test set.
26
 
 
20
 
21
  from llmware.models import ModelCatalog
22
  model = ModelCatalog().load_model("llmware/bling-stablelm-3b-gguf")
23
+ response = model.inference(query, add_context=text_sample, add_prompt_engineering="default_with_context")
24
 
25
  Note: please review [**config.json**](https://huggingface.co/llmware/bling-stablelm-3b-gguf/blob/main/config.json) in the repository for prompt wrapping information, details on the model, and full test set.
26