|
--- |
|
base_model: |
|
- Xiaojian9992024/Qwen2.5-Dyanka-7B-Preview |
|
- jeffmeloy/Qwen2.5-7B-nerd-uncensored-v1.0 |
|
- jeffmeloy/Qwen2.5-7B-olm-v1.1 |
|
library_name: transformers |
|
tags: |
|
- mergekit |
|
- merge |
|
|
|
--- |
|
# 📊 OLMNER-7B Benchmark Results |
|
|
|
OLMNER-7B has been evaluated and ranked **TOP 27** in the 7B models category! |
|
|
|
## 🔥 Performance Scores |
|
|
|
| Metric | Score | |
|
|----------------------|--------| |
|
| **Average Score** | **35.56%** | |
|
| **IFEval** | **72.54%** | |
|
| **BBH** | **35.75%** | |
|
| **MATH** | **46.30%** | |
|
| **GPQA** | **7.72%** | |
|
| **MUSR** | **14.31%** | |
|
| **MMLU-PRO** | **36.77%** | |
|
|
|
🌍 **Carbon Emission Estimate:** **0.65 kg CO₂** |
|
|
|
### Configuration |
|
|
|
The following YAML configuration was used to produce this model: |
|
|
|
```yaml |
|
models: |
|
- model: Xiaojian9992024/Qwen2.5-Dyanka-7B-Preview |
|
- model: jeffmeloy/Qwen2.5-7B-nerd-uncensored-v1.0 |
|
parameters: |
|
density: 0.5 |
|
weight: 0.5 |
|
- model: jeffmeloy/Qwen2.5-7B-olm-v1.1 |
|
parameters: |
|
density: 0.5 |
|
weight: 0.5 |
|
merge_method: ties |
|
base_model: Xiaojian9992024/Qwen2.5-Dyanka-7B-Preview |
|
parameters: |
|
normalize: false |
|
int8_mask: true |
|
dtype: bfloat16 |
|
``` |
|
|
