Update README.md
Browse files
README.md
CHANGED
|
@@ -3,4 +3,26 @@ license: other
|
|
| 3 |
datasets:
|
| 4 |
- rombodawg/LosslessMegaCodeTrainingV2_1m_Evol_Uncensored
|
| 5 |
---
|
| 6 |
-
- [wandb](https://wandb.ai/open-assistant/epfl-mt-sft/runs/run17_megacode_min100)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
datasets:
|
| 4 |
- rombodawg/LosslessMegaCodeTrainingV2_1m_Evol_Uncensored
|
| 5 |
---
|
| 6 |
+
- [wandb](https://wandb.ai/open-assistant/epfl-mt-sft/runs/run17_megacode_min100)
|
| 7 |
+
|
| 8 |
+
- This is one of the first models trained on the LosslessMegaCodeTrainingV2_1m_Evol_Uncensored dataset. The version of the dataset used for this model was poorly filtered on some loose parameters that arent anything to write home about but plans for much more refined filtering are in the works
|
| 9 |
+
|
| 10 |
+
The link for the full dataset is bellow:
|
| 11 |
+
|
| 12 |
+
https://huggingface.co/datasets/rombodawg/LosslessMegaCodeTrainingV2_1m_Evol_Uncensored
|
| 13 |
+
|
| 14 |
+
Link for the filtered dataset used to make this model are bellow:
|
| 15 |
+
|
| 16 |
+
https://huggingface.co/datasets/andreaskoepf/megacode2-min100
|
| 17 |
+
|
| 18 |
+
This model is extremely good at coding, and might be one of the best coding models for its size and much better than any 7b parameter model. Plans for bigger models are coming in the future.
|
| 19 |
+
|
| 20 |
+
The chat format for this model is alpaca
|
| 21 |
+
```
|
| 22 |
+
USER: {prompt}
|
| 23 |
+
ASSISTANT:
|
| 24 |
+
```
|
| 25 |
+
|
| 26 |
+
The original posting for this model was uploaded at the link bellow. This model was made as a colaboration between me and andreaskoepf.
|
| 27 |
+
|
| 28 |
+
https://huggingface.co/andreaskoepf/llama2-7b-megacode2_min100
|