OpenVINO
/

open_llama_3b_v2-int8-ov

Text Generation

Inference Endpoints

Model card Files Files and versions Community

katuni4ka commited on Jul 24

Commit

5c3c69a

•

1 Parent(s): 7a83686

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -80,7 +80,7 @@ import openvino_genai as ov_genai
 device = "CPU"
 pipe = ov_genai.LLMPipeline(model_path, device)
-print(pipe.generate("What is OpenVINO?"))
 ```
 More GenAI usage examples can be found in OpenVINO GenAI library [docs](https://github.com/openvinotoolkit/openvino.genai/blob/master/src/README.md) and [samples](https://github.com/openvinotoolkit/openvino.genai?tab=readme-ov-file#openvino-genai-samples)

 device = "CPU"
 pipe = ov_genai.LLMPipeline(model_path, device)
+print(pipe.generate("What is OpenVINO?", max_length=200))
 ```
 More GenAI usage examples can be found in OpenVINO GenAI library [docs](https://github.com/openvinotoolkit/openvino.genai/blob/master/src/README.md) and [samples](https://github.com/openvinotoolkit/openvino.genai?tab=readme-ov-file#openvino-genai-samples)