Update README.md
Browse files
README.md
CHANGED
@@ -18,11 +18,13 @@ This model can answer information in turkish language as it is finetuned on a tu
|
|
18 |
- **Finetuned from model:** [`microsoft/phi-2`](https://huggingface.co/microsoft/phi-2)
|
19 |
|
20 |
### Prompt Template
|
21 |
-
|
22 |
-
```
|
23 |
-
<s>[INST] <prompt> [/INST] </s>
|
24 |
```
|
|
|
25 |
|
|
|
|
|
|
|
|
|
26 |
## How to Get Started with the Model
|
27 |
|
28 |
Use the code sample provided in the original post to interact with the model.
|
@@ -39,8 +41,8 @@ tokenizer = AutoTokenizer.from_pretrained(model_id)
|
|
39 |
|
40 |
question: "Türkiyenin en büyük şehir nedir?"
|
41 |
# For generating a response
|
42 |
-
prompt = '''
|
43 |
-
|
44 |
'''
|
45 |
input_ids = tokenizer(prompt, return_tensors="pt").input_ids
|
46 |
output = model.generate(inputs=input_ids,max_new_tokens=512,pad_token_id=tokenizer.eos_token_id,top_k=50, do_sample=True,repetition_penalty=1.3
|
|
|
18 |
- **Finetuned from model:** [`microsoft/phi-2`](https://huggingface.co/microsoft/phi-2)
|
19 |
|
20 |
### Prompt Template
|
|
|
|
|
|
|
21 |
```
|
22 |
+
### Instruction:
|
23 |
|
24 |
+
<prompt> (without the <>)
|
25 |
+
|
26 |
+
### Response:
|
27 |
+
```
|
28 |
## How to Get Started with the Model
|
29 |
|
30 |
Use the code sample provided in the original post to interact with the model.
|
|
|
41 |
|
42 |
question: "Türkiyenin en büyük şehir nedir?"
|
43 |
# For generating a response
|
44 |
+
prompt = f'''
|
45 |
+
### Instruction: {question} ### Response:
|
46 |
'''
|
47 |
input_ids = tokenizer(prompt, return_tensors="pt").input_ids
|
48 |
output = model.generate(inputs=input_ids,max_new_tokens=512,pad_token_id=tokenizer.eos_token_id,top_k=50, do_sample=True,repetition_penalty=1.3
|