Hugging Face's logo

Kquant03
/
FrankenDPO-4x7B-bf16

Text Generation
Transformers
Safetensors
English
mixtral
Merge
Mixture of Experts
Inference Endpoints
text-generation-inference
Model card Files Community
1
Kquant03 commited on
Commit
7a18f14
•
1 Parent(s): 611a5ac

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -4,6 +4,7 @@ language:
4
  - en
5
  tags:
6
  - merge
 
7
  ---
8
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6589d7e6586088fd2784a12c/7JsqBt8QRiZmcMh-ameqH.jpeg)
9
  # It's alive!!!! Half the size and better on GSM8k and Winogrande than Mixtral Instruct 8x 7B! Also Rank 6 on Ayumi's ERP Bench!
 
4
  - en
5
  tags:
6
  - merge
7
+ - moe
8
  ---
9
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6589d7e6586088fd2784a12c/7JsqBt8QRiZmcMh-ameqH.jpeg)
10
  # It's alive!!!! Half the size and better on GSM8k and Winogrande than Mixtral Instruct 8x 7B! Also Rank 6 on Ayumi's ERP Bench!