Hugging Face's logo

RDson
/
Llama-3-Magenta-Instruct-4x8B-MoE

Text Generation
Transformers
Safetensors
mixtral
Mixture of Experts
llama
3
llama 3
4x8b
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
RDson commited on
Commit
b316d38
•
1 Parent(s): c6ab2a3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -9,8 +9,12 @@ tags:
9
  <img src="https://i.imgur.com/c1Mv8cy.png" width="640"/>
10
 
11
  # Llama-3-Magenta-Instruct-4x8B-MoE
 
 
 
12
  This is a experimental MoE created from [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct), [nvidia/Llama3-ChatQA-1.5-8B](https://huggingface.co/nvidia/Llama3-ChatQA-1.5-8B), [Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R](https://huggingface.co/Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R) and [Muhammad2003/Llama3-8B-OpenHermes-DPO](https://huggingface.co/Muhammad2003/Llama3-8B-OpenHermes-DPO) using Mergekit.
13
 
 
14
  Mergekit yaml file:
15
  ```
16
  base_model: Meta-Llama-3-8B-Instruct
 
9
  <img src="https://i.imgur.com/c1Mv8cy.png" width="640"/>
10
 
11
  # Llama-3-Magenta-Instruct-4x8B-MoE
12
+
13
+ GGUF files are available here: [RDson/Llama-3-Magenta-Instruct-4x8B-MoE-GGUF](https://huggingface.co/RDson/Llama-3-Magenta-Instruct-4x8B-MoE-GGUF).
14
+
15
  This is a experimental MoE created from [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct), [nvidia/Llama3-ChatQA-1.5-8B](https://huggingface.co/nvidia/Llama3-ChatQA-1.5-8B), [Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R](https://huggingface.co/Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R) and [Muhammad2003/Llama3-8B-OpenHermes-DPO](https://huggingface.co/Muhammad2003/Llama3-8B-OpenHermes-DPO) using Mergekit.
16
 
17
+
18
  Mergekit yaml file:
19
  ```
20
  base_model: Meta-Llama-3-8B-Instruct