Create README.md

README.md

@@ -0,0 +1,12 @@
+# Mistral-7B-v0.2-OpenHermes-AWQ
+
+Original [Model](https://huggingface.co/macadeliccc/Mistral-7B-v0.2-OpenHermes)
+
+command to launch on vllm
+
+```bash
+python -m vllm.entrypoints.openai.api_server \
+    --model macadeliccc/Mistral-7B-v0.2-OpenHermes-AWQ \
+    --chat-template ./examples/template_chatml.jinja \
+    --gpu-memory-utilization 0.9
+```