heegyu commited on
Commit
ec8f491
1 Parent(s): 97372ca

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -0
README.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Locutusque/TinyMistral-248M-v2.5-Instruct
3
+ license: apache-2.0
4
+ datasets:
5
+ - HuggingFaceH4/ultrafeedback_binarized
6
+ ---
7
+
8
+ ```
9
+ from transformers import AutoTokenizer, AutoModelForCausalLM
10
+
11
+ tokenizer = AutoTokenizer.from_pretrained("heegyu/TinyMistral-248M-v2.5-Instruct-orpo")
12
+ model = AutoModelForCausalLM.from_pretrained("heegyu/TinyMistral-248M-v2.5-Instruct-orpo")
13
+
14
+ conv = [
15
+ {
16
+ 'role': 'user',
17
+ 'content': 'What can I do with Large Language Model?'
18
+ }
19
+ ]
20
+ prompt = tokenizer.apply_chat_template(conv, add_generation_prompt=True, return_tensors="pt")
21
+ output = model.generate(prompt, max_new_token=128)
22
+ print(tokenizer.decode(output[0]))
23
+ ```