Update README.md

README.md

@@ -20,6 +20,26 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) on the generator dataset.
 
+## USE CASE
+
+import torch
+from peft import AutoPeftModelForCausalLM
+from transformers import AutoTokenizer, pipeline
+
+peft_model_id = "frankmorales2020/Mistral-7B-text-to-sql"
+# peft_model_id = args.output_dir
+
+# Load Model with PEFT adapter
+model = AutoPeftModelForCausalLM.from_pretrained(
+  peft_model_id,
+  device_map="auto",
+  torch_dtype=torch.float16
+)
+tokenizer = AutoTokenizer.from_pretrained(peft_model_id)
+# Load into the pipeline
+pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
+
+
 ## Model description
 
 More information needed