Create README.md

README.md

@@ -0,0 +1,23 @@
+![image of llama engineer](https://i.imgur.com/JlhW0ri.png)
+
+## Llama-Engineer-Evol-7B
+
+This is a version of Meta's chat instruction-tuned Llama 2 further fine-tuned on over 80,000 coding samples. 
+
+The dataset is a combination of [Evol-Instruct-Code-80k-v1](https://huggingface.co/datasets/nickrosh/Evol-Instruct-Code-80k-v1) from [nikrosh](https://huggingface.co/nickrosh), a replication of the Evol-Instruct-Code as described in the WizardCoder Paper, and [Teknium](https://huggingface.co/teknium)'s [GPTeacher](https://github.com/teknium1/GPTeacher/blob/main/Codegen/codegen-instruct.json). Special thanks to these folks for putting these datasets together.
+
+
+### Prompt Format
+The reccomended model usage is a variant of the standard Llama 2 format:
+```
+[INST] <<SYS>>
+You are a helpful programming assistant. Always answer as helpfully as possible. Be direct in your response and get to the answer right away. Responses should be short.
+<</SYS>>
+{your prompt}[/INST]
+```
+
+
+### Next Steps
+- Prune the dataset and possibly fine-tune for longer.
+- Run benchmarks.
+- Provide GGML and GPTQ.