nisten commited on
Commit
6fb6822
1 Parent(s): 6fccba9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -1
README.md CHANGED
@@ -1,10 +1,17 @@
1
  ---
2
  license: llama3
3
  base_model: meta-llama/Meta-Llama-3-8B-Instruct
 
 
 
 
 
 
 
4
  ---
5
 
6
  Meow.
7
- Tis an experimental mixture of two expert models based on Llama 3 Instruct plain in combo with finetune. Specifically, it is built on top of the Meta-Llama-3-8B-Instruct model and Argilla Capybara dataset,
8
 
9
 
10
 
 
1
  ---
2
  license: llama3
3
  base_model: meta-llama/Meta-Llama-3-8B-Instruct
4
+ datasets:
5
+ - argilla/distilabel-capybara-dpo-7k-binarized
6
+ language:
7
+ - en
8
+ library_name: transformers
9
+ tags:
10
+ - moe
11
  ---
12
 
13
  Meow.
14
+ This an experimental mixture of expert model with just 2 experts based on Llama 3 Instruct plain in combo with finetune. Specifically, it is built on top of the Meta-Llama-3-8B-Instruct model and finetune is trained on Argilla Capybara dataset.
15
 
16
 
17