ONLY UPLOADED FROM RUNPOD JUST TO TEST ON OWN SYSTEM. UNTESTED SO FAR. V2 SOON
CURRENT CHANGES:
INCREASED MODEL WEIGHTS AND DENSITIES IN TIES-MERGE FOR P1 & P2
GRADIENT MERGE BETWEEN P2 & P1 CAN'T BE ILLUSTRATED, TENSORS EACH HAD UNIQUE RATIOS AND GRADIENTS APPLIED
An experimental merging of Several Models using two various methods, Ties-Merge and BlockMerge_Gradient
Stheno:
Gradient Merge of Stheno-P2 & Stheno-P1.
Test Checklist:
Censorship - ____
Writing - ____
NSFW - ___
IQ Level - ___
Formatting - ____
Most formats could work, use Alpaca format and it works well.
### Instruction:
Your instruction or question here.
For roleplay purposes, I suggest the following - Write <CHAR NAME>'s next reply in a chat between <YOUR NAME> and <CHAR NAME>. Write a single reply only.
### Response:
Gradient Merge Pictures Unavailable, Several Different Tensor Ratios applied.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
Metric | Value |
---|---|
Avg. | 48.8 |
ARC (25-shot) | 59.39 |
HellaSwag (10-shot) | 83.01 |
MMLU (5-shot) | 55.77 |
TruthfulQA (0-shot) | 51.22 |
Winogrande (5-shot) | 74.66 |
GSM8K (5-shot) | 8.95 |
DROP (3-shot) | 8.61 |
- Downloads last month
- 3,209