Update README.md

README.md

@@ -5,6 +5,19 @@ language:
 ---
 
 Original model from https://huggingface.co/openlm-research/open_llama_3b_600bt_preview.
+Example below edited from https://github.com/openlm-research/open_llama
+```
+import torch
+from transformers import AutoTokenizer, AutoModelForCausalLM
+model_name = "danielhanchen/open_llama_3b_600bt_preview"
+
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype = torch.float16, device_map = "auto")
+
+prompt = "Q: What is the largest animal?\nA:"
+input_ids = tokenizer(prompt, return_tensors = "pt").input_ids
+print( tokenizer.decode( model.generate( input_ids, max_new_tokens = 32).ravel() ) )
+```
 
 This repo includes:
 1) Ported `LlamaTokenizer` to `LlamaTokenizerFast` via a few lines of code.