🔥 OpenZephyrChat - Merging Zephyr-beta with OpenChat-3.5 🔥

This Model is a ties merge between Zephyr-beta and OpenChat-3.5, it was done by using the https://github.com/cg123/mergekit repository

Model Information

• License: Apache-2 (commercially usable)
• Parameter size: 7B
• Merge:
  • OpenChat with --weight 0.6 --density 0.5
  • Zephyr with --weight 0.3 --density 0.5
  • Mistral serving as the base model

Evals

BENCHMARK	SCORE
ARC	64.85
HellaSwag	85.08
MMLU	64.92
TruthfulQA	48.24
Winogrande	81.06
GSM8K	64.59

Source