Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,26 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
inference: false
|
3 |
+
license: other
|
4 |
+
---
|
5 |
+
|
6 |
+
# AlpaGasus-7B Model Card
|
7 |
+
|
8 |
+
## Model Details
|
9 |
+
|
10 |
+
This is an **unofficial** implementation of AlpaGasus-7B, which is a chat assistant trained by fine-tuning LLaMA on a Claud-filtered Alpaca dataset with around 5K triplets.
|
11 |
+
|
12 |
+
- **Developed by:** [gpt4life](https://github.com/gpt4life)
|
13 |
+
- **Model type:** An auto-regressive language model based on the transformer architecture.
|
14 |
+
- **License:** Non-commercial license
|
15 |
+
- **Finetuned from model:** [LLaMA-7B](https://huggingface.co/elinas/llama-7b-hf-transformers-4.29).
|
16 |
+
|
17 |
+
Please see the original LLaMA [license](https://github.com/facebookresearch/llama/blob/main/LICENSE) before using this model.
|
18 |
+
|
19 |
+
### Model Sources
|
20 |
+
|
21 |
+
- **Repository:** https://github.com/gpt4life/alpagasus
|
22 |
+
- **Paper:** https://arxiv.org/pdf/2307.08701.pdf
|
23 |
+
|
24 |
+
## Training Details
|
25 |
+
|
26 |
+
AlpaGasus-7B is fine-tuned from LLaMA-7B with supervised instruction fine-tuning on the filtered [Alpaca dataset](https://github.com/gpt4life/alpagasus/blob/main/rating/alpaca_filtered_data.json).
|