zoltanctoth
commited on
Commit
•
e7a6269
1
Parent(s):
bcef6d7
nicer output in example
Browse files
README.md
CHANGED
@@ -18,7 +18,7 @@ pip install ctransformers
|
|
18 |
```
|
19 |
|
20 |
Here is a self-contained Python script to get you started:
|
21 |
-
|
22 |
```
|
23 |
from ctransformers import AutoModelForCausalLM
|
24 |
|
@@ -31,5 +31,6 @@ instruction = "Which is the biggest city of India?"
|
|
31 |
|
32 |
prompt = f"### System:\n{system}\n\n### User:\n{instruction}\n\n### Response:\n"
|
33 |
for i in llm(prompt, stream=True):
|
34 |
-
print(i)
|
|
|
35 |
```
|
|
|
18 |
```
|
19 |
|
20 |
Here is a self-contained Python script to get you started:
|
21 |
+
|
22 |
```
|
23 |
from ctransformers import AutoModelForCausalLM
|
24 |
|
|
|
31 |
|
32 |
prompt = f"### System:\n{system}\n\n### User:\n{instruction}\n\n### Response:\n"
|
33 |
for i in llm(prompt, stream=True):
|
34 |
+
print(i, end="", flush=True)
|
35 |
+
print()
|
36 |
```
|