Weyaxi/2x-LoRA-Assemble-13B

Merge of oh-yeontaek/llama-2-13B-LoRA-assemble and oh-yeontaek/llama-2-13B-LoRA-assemble using ties merge. (It is weird, it was a mistake but the score is 0.01 point better)

Weights

• oh-yeontaek/llama-2-13B-LoRA-assemble: 0.5

• oh-yeontaek/llama-2-13B-LoRA-assemble: 0.3

Density

• oh-yeontaek/llama-2-13B-LoRA-assemble: 0.5

• oh-yeontaek/llama-2-13B-LoRA-assemble: 0.5

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	51.52
ARC (25-shot)	63.65
HellaSwag (10-shot)	83.47
MMLU (5-shot)	59.82
TruthfulQA (0-shot)	55.94
Winogrande (5-shot)	76.48
GSM8K (5-shot)	9.25
DROP (3-shot)	12.01