Update README.md
Browse files
README.md
CHANGED
@@ -1,5 +1,6 @@
|
|
1 |
---
|
2 |
license: wtfpl
|
|
|
3 |
datasets:
|
4 |
- migtissera/Synthia-v1.3
|
5 |
language:
|
@@ -10,7 +11,7 @@ language:
|
|
10 |
# MAMBA (2.8B) 🐍 fine-tuned on Synthia-v1.3
|
11 |
|
12 |
<div style="text-align:center;width:250px;height:250px;">
|
13 |
-
<img src="https://huggingface.co/clibrain/mamba-2.8b-
|
14 |
</div>
|
15 |
|
16 |
Model Card is still WIP!
|
@@ -24,20 +25,7 @@ with an efficient hardware-aware design and implementation in the spirit of [Fla
|
|
24 |
|
25 |
## Dataset info
|
26 |
|
27 |
-
|
28 |
-
|
29 |
-
OpenHermes 13B is the first fine tune of the Hermes dataset that has a fully open source dataset!
|
30 |
-
|
31 |
-
OpenHermes was trained on 242,000 entries of primarily GPT-4 generated data, from open datasets across the AI landscape, including:
|
32 |
-
|
33 |
-
- GPTeacher - General Instruct, Roleplay v1, Roleplay v2, and Code Instruct Datasets, by Teknium
|
34 |
-
- WizardLM (v1, evol_instruct 70k), by WizardLM Team/nlpxucan
|
35 |
-
- Airoboros GPT-4 (v1.0), by JonDurbin
|
36 |
-
- Camel-AI's domain expert datasets, by the Camel-AI Team
|
37 |
-
- CodeAlpaca, by Sahil2801
|
38 |
-
- GPT4-LLM and Unnatural Instructions, by Microsoft
|
39 |
-
Filtering included removal of OpenAI refusals, disclaimers, and "As an AI" type examples and more
|
40 |
-
The base dataset mix is identical to the original Nous-Hermes', minus the Nous-Instruct and PDACTL datasets which were private datasets.
|
41 |
|
42 |
## Usage
|
43 |
|
|
|
1 |
---
|
2 |
license: wtfpl
|
3 |
+
thumbnail: https://huggingface.co/clibrain/mamba-2.8b-ft-synthia-v1.3/resolve/main/mamba-syn-removebg-preview.png?download=true
|
4 |
datasets:
|
5 |
- migtissera/Synthia-v1.3
|
6 |
language:
|
|
|
11 |
# MAMBA (2.8B) 🐍 fine-tuned on Synthia-v1.3
|
12 |
|
13 |
<div style="text-align:center;width:250px;height:250px;">
|
14 |
+
<img src="https://huggingface.co/clibrain/mamba-2.8b-ft-synthia-v1.3/resolve/main/mamba-syn-removebg-preview.png" alt="mamba-hermes logo"">
|
15 |
</div>
|
16 |
|
17 |
Model Card is still WIP!
|
|
|
25 |
|
26 |
## Dataset info
|
27 |
|
28 |
+
Not Provided
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
29 |
|
30 |
## Usage
|
31 |
|