Update README.md

README.md

@@ -21,4 +21,25 @@ Borrowed some ideas from my other "distillation" technique, which significantly
 
 Thanks and have fun!!
 
-Also happy birthday to myself :)
+Also happy birthday to myself :)
+
+Usage (taken from official Gemma 2 9B repo):
+```python
+import torch
+from transformers import pipeline
+
+pipe = pipeline(
+    "text-generation",
+    model="minchyeom/birthday-llm",
+    model_kwargs={"torch_dtype": torch.bfloat16},
+    device="cuda",  # replace with "mps" to run on a Mac device
+)
+
+messages = [
+    {"role": "user", "content": "How many r's are there in the word strawberry?"},
+]
+
+outputs = pipe(messages, max_new_tokens=256)
+assistant_response = outputs[0]["generated_text"][-1]["content"].strip()
+print(assistant_response)
+```