Update README.md

README.md

@@ -24,6 +24,33 @@ Overview
 
  is an advanced AI model designed by the nextai-team for the purpose of enhancing question answering and code generation capabilities. Building upon the foundation of its predecessor, Moe-4x7b-reason-code-qa, this iteration introduces refined mechanisms and expanded training datasets to deliver more precise and contextually relevant responses.
 
+How to Use
+
+```from transformers import AutoTokenizer
+import transformers
+import torch
+
+model = "nextai-team/Moe-2x7b-QA-Code" #If you want to test your own model, replace this value with the model directory path
+
+tokenizer = AutoTokenizer.from_pretrained(model)
+pipeline = transformers.pipeline(
+    "text-generation",
+    model=model,
+    device_map="auto",
+    model_kwargs={"torch_dtype": torch.float16},
+)
+
+def generate_resposne(query):
+    messages = [{"role": "user", "content": query}]
+    prompt = pipeline.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
+    outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
+    return outputs[0]['generated_text']
+
+response = generate_resposne("How to learn coding .Please provide a step by step procedure")
+print(response)
+
+```
+
 Intended Use
 
 This model is intended for developers, data scientists, and researchers seeking to integrate sophisticated natural language understanding and code generation functionalities into their applications. Ideal use cases include but are not limited to: