Update README.md

README.md

@@ -9,14 +9,31 @@ library_name: transformers
 
 Merge of two SOLAR models. This is an experiment to improve models ability to learn math and retain other skills.
 
-![solar](solar.png)
-
-## 🌟 Usage 
+![solar](solar-math.png)
 
 
 ## 🌅 Code Example
 
-TODO
+```python
+import torch
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+tokenizer = AutoTokenizer.from_pretrained("macadeliccc/SOLAR-math-2x10.7b",load_in_4bit=True)
+model = AutoModelForCausalLM.from_pretrained(
+    "macadeliccc/SOLAR-math-2x10.7b",
+    device_map="auto",
+    torch_dtype=torch.float16,
+)
+
+conversation = [ {'role': 'user', 'content': 'A rectangle has a length that is twice its width and its area is 50 square meters. Find the dimensions of the rectangle.'} ] 
+
+prompt = tokenizer.apply_chat_template(conversation, tokenize=False, add_generation_prompt=True)
+
+inputs = tokenizer(prompt, return_tensors="pt").to(model.device) 
+outputs = model.generate(**inputs, use_cache=True, max_length=4096)
+output_text = tokenizer.decode(outputs[0]) 
+print(output_text)
+```
 
 ## Evaluations