Added demo code according to the prompt format

model response from this code:

The neural-chat-7b-v3-1 model is a language model developed by OpenAI. It is a large-scale, multilingual, and highly capable model that can generate human-like text. It is based on the GPT-3 architecture and has been trained on a vast amount of text data, including books, articles, and web pages.

The model works by using deep learning techniques to analyze and understand the context of the given input text. It then generates an output text that is relevant and coherent with the input, while also maintaining a natural language flow. The neural-chat-7b-v3-1 model is designed to be versatile and can be used for various tasks such as conversation, text completion, and text generation.

In summary, the neural-chat-7b-v3-1 model works by learning from a massive amount of text data and using advanced deep learning algorithms to generate human-like responses based on the input text.

README.md

@@ -52,11 +52,36 @@ The following hyperparameters were used during training:
 
 ## Inference with transformers
 
-```shell
+```python
 import transformers
-model = transformers.AutoModelForCausalLM.from_pretrained(
-  'Intel/neural-chat-7b-v3-1'
-)
+
+
+model_name = 'Intel/neural-chat-7b-v3-1'
+model = transformers.AutoModelForCausalLM.from_pretrained(model_name)
+tokenizer = transformers.AutoTokenizer.from_pretrained(model_name)
+
+
+def generate_response(system_input, user_input):
+    
+    # Format the input using the provided template
+    prompt = f"### System:\n{system_input}\n### User:\n{user_input}\n### Assistant:\n"
+
+    # Tokenize and encode the prompt
+    inputs = tokenizer.encode(prompt, return_tensors="pt")
+
+    # Generate a response
+    outputs = model.generate(inputs, max_length=1000, num_return_sequences=1)
+    response = tokenizer.decode(outputs[0], skip_special_tokens=True)
+
+    # Extract only the assistant's response
+    return response.split("### Assistant:\n")[-1]
+
+
+# Example usage
+system_input = "You are a chatbot developed by Intel. Please answer all questions to the best of your ability."
+user_input = "How does the neural-chat-7b-v3-1 model work?"
+response = generate_response(system_input, user_input)
+print(response)
 ```
 
 ## Ethical Considerations and Limitations