File size: 659 Bytes
ec8f491 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
---
base_model: Locutusque/TinyMistral-248M-v2.5-Instruct
license: apache-2.0
datasets:
- HuggingFaceH4/ultrafeedback_binarized
---
```
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("heegyu/TinyMistral-248M-v2.5-Instruct-orpo")
model = AutoModelForCausalLM.from_pretrained("heegyu/TinyMistral-248M-v2.5-Instruct-orpo")
conv = [
{
'role': 'user',
'content': 'What can I do with Large Language Model?'
}
]
prompt = tokenizer.apply_chat_template(conv, add_generation_prompt=True, return_tensors="pt")
output = model.generate(prompt, max_new_token=128)
print(tokenizer.decode(output[0]))
``` |