Create README.md

README.md

@@ -0,0 +1,124 @@
+---
+license: apache-2.0
+tags:
+- OpenAccess AI Collective
+- MPT
+- axolotl
+datasets:
+- ehartford/WizardLM_alpaca_evol_instruct_70k_unfiltered
+- QingyiSi/Alpaca-CoT
+- teknium/GPTeacher-General-Instruct
+- metaeval/ScienceQA_text_only
+- hellaswag
+- openai/summarize_from_feedback
+- riddle_sense
+- gsm8k
+- camel-ai/math
+- camel-ai/biology
+- camel-ai/physics
+- camel-ai/chemistry
+- winglian/evals
+
+inference: false
+---
+
+[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
+**[💵 Donate to OpenAccess AI Collective](https://github.com/sponsors/OpenAccess-AI-Collective) to help us keep building great tools and models!**
+
+# Minotaur 7B
+
+Minotaur 7B is an instruct fine-tuned model on top of LlaMA-13B. Minotaur 7B is fine-tuned **on only completely open datasets** making this model reproducible by anyone.
+
+Questions, comments, feedback, looking to donate, or want to help? Reach out on our [Discord](https://discord.gg/PugNNHAF5r) or email [wing@openaccessaicollective.org](mailto:wing@openaccessaicollective.org)
+
+# Prompts
+Chat only style prompts using `USER:`,`ASSISTANT:`.
+
+<img src="https://huggingface.co/openaccess-ai-collective/minotaur-7b/resolve/main/minotaur.png" alt="minotaur" width="600" height="500"/>
+
+# Training Datasets
+
+Minotaur 7B model is fine-tuned on the following openly available datasets:
+
+- [WizardLM](https://huggingface.co/datasets/ehartford/WizardLM_alpaca_evol_instruct_70k_unfiltered)
+- [subset of QingyiSi/Alpaca-CoT for roleplay and CoT](https://huggingface.co/QingyiSi/Alpaca-CoT)
+- [GPTeacher-General-Instruct](https://huggingface.co/datasets/teknium/GPTeacher-General-Instruct)
+- [metaeval/ScienceQA_text_only](https://huggingface.co/datasets/metaeval/ScienceQA_text_only) - instruct for concise responses
+- [openai/summarize_from_feedback](https://huggingface.co/datasets/openai/summarize_from_feedback) - instruct augmented tl;dr summarization
+- [camel-ai/math](https://huggingface.co/datasets/camel-ai/math)
+- [camel-ai/physics](https://huggingface.co/datasets/camel-ai/physics)
+- [camel-ai/chemistry](https://huggingface.co/datasets/camel-ai/chemistry)
+- [camel-ai/biology](https://huggingface.co/datasets/camel-ai/biology)
+- [winglian/evals](https://huggingface.co/datasets/winglian/evals) - instruct augmented datasets
+  - custom sysnthetic datasets around misconceptions, in-context qa, jokes, N-tasks problems, and context-insensitivity
+  - ARC-Easy & ARC-Challenge - instruct augmented for detailed responses, derived from the `train` split
+  - [hellaswag](https://huggingface.co/datasets/hellaswag) - 30K+ rows of instruct augmented for detailed explanations w 30K+ rows, derived from the `train` split
+  - [riddle_sense](https://huggingface.co/datasets/riddle_sense) - instruct augmented 
+  - [gsm8k](https://huggingface.co/datasets/gsm8k) - instruct augmented
+  - prose generation
+
+# Shoutouts
+
+Special thanks to Nanobit for helping with Axolotl and TheBloke for quantizing these models are more accessible to all.
+
+# Demo
+
+HF Demo in Spaces available in the [Community ChatBot Arena](https://huggingface.co/spaces/openaccess-ai-collective/rlhf-arena) under the OAAIC Chatbots tab.
+
+## Release Notes
+
+- https://wandb.ai/wing-lian/minotaur-13b/runs/ucgd0x6n
+
+## Build
+
+Minotaur was built with [Axolotl](https://github.com/OpenAccess-AI-Collective/axolotl) on 8x RTXA6000
+ - 1 epochs taking approximately 1.5 hours
+
+## Bias, Risks, and Limitations
+Minotaur has not been aligned to human preferences with techniques like RLHF or deployed with in-the-loop filtering of responses like ChatGPT, so the model can produce problematic outputs (especially when prompted to do so).
+Minotaur was fine-tuned from the base model LLaMA 13B, please refer to its model card's Limitations Section for relevant information. (included below)
+
+## Benchmarks
+
+TBD
+
+
+## Examples - results may vary based on temperature and other settings
+
+
+```
+The following is a chat between a USER and a friendly and helpful ASSISTANT.                                                                                                                            
+USER: You have 5 apples. You eat 3 pears. How many apples do you have left?                                                                                                                                 
+ASSISTANT:You still have 5 apples because eating pears does not affect the number of apples you have.
+```
+
+```
+The following is a chat between a USER and a friendly and helpful ASSISTANT.
+USER: List three words that start with "ex". What is 33 + 77?
+ASSISTANT:Three words starting with the letter 'e' are excited, eatable, and expensive. 33+77 equals 106.
+```
+
+```
+The following is a chat between a USER and a friendly and helpful ASSISTANT.
+USER: Solve for x: 5x = 3x + 10
+ASSISTANT:To solve the equation 5x = 3x + 10, we can follow these steps:
+
+Step 1: Add both sides of the equation to get a common denominator.
+(1/5)x = 1 (common)
+
+Subtract the term with "x" on both sides.
+-2/5 x = 10
+
+Step 2: To solve the resulting equation, isolate the variable "x".
+First, multiply all terms by 5 to eliminate the fractions.
+5x = 15
+
+Now, divide the entire right side by 5.
+x = 15/5
+
+Finally, simplify to get the solution in its simplest form.
+x = 1
+
+So, the solution is x = 1.
+```
+Yup, 7B still sucks at math