Update README.md
Browse files
README.md
CHANGED
@@ -6,11 +6,14 @@ tags:
|
|
6 |
- llama 3
|
7 |
- 4x8b
|
8 |
---
|
9 |
-
<img src="https://i.imgur.com/c1Mv8cy.png" width="640"/>
|
10 |
|
11 |
# Llama-3-Magenta-Instruct-4x8B-MoE
|
|
|
|
|
|
|
|
|
12 |
|
13 |
-
GGUF files are available here: [
|
14 |
|
15 |
This is a experimental MoE created from [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct), [nvidia/Llama3-ChatQA-1.5-8B](https://huggingface.co/nvidia/Llama3-ChatQA-1.5-8B), [Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R](https://huggingface.co/Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R) and [Muhammad2003/Llama3-8B-OpenHermes-DPO](https://huggingface.co/Muhammad2003/Llama3-8B-OpenHermes-DPO) using Mergekit.
|
16 |
|
|
|
6 |
- llama 3
|
7 |
- 4x8b
|
8 |
---
|
|
|
9 |
|
10 |
# Llama-3-Magenta-Instruct-4x8B-MoE
|
11 |
+
<img src="https://i.imgur.com/c1Mv8cy.png" width="640"/>
|
12 |
+
|
13 |
+
|
14 |
+
You should also check out the updated [Llama-3-Peach-Instruct-4x8B-MoE](https://huggingface.co/RDson/Llama-3-Peach-Instruct-4x8B-MoE)!
|
15 |
|
16 |
+
GGUF files are available here: [Llama-3-Magenta-Instruct-4x8B-MoE-GGUF](https://huggingface.co/RDson/Llama-3-Magenta-Instruct-4x8B-MoE-GGUF).
|
17 |
|
18 |
This is a experimental MoE created from [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct), [nvidia/Llama3-ChatQA-1.5-8B](https://huggingface.co/nvidia/Llama3-ChatQA-1.5-8B), [Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R](https://huggingface.co/Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R) and [Muhammad2003/Llama3-8B-OpenHermes-DPO](https://huggingface.co/Muhammad2003/Llama3-8B-OpenHermes-DPO) using Mergekit.
|
19 |
|