|
--- |
|
license: llama2 |
|
language: |
|
- en |
|
pipeline_tag: text-generation |
|
inference: false |
|
tags: |
|
- dare |
|
- super mario merge |
|
- pytorch |
|
- llama |
|
- codellama |
|
- merge |
|
--- |
|
|
|
# codellama 34b mega merge |
|
|
|
The following were merged with DARE using [https://github.com/martyn/safetensors-merge-supermario](https://github.com/martyn/safetensors-merge-supermario) |
|
|
|
## Mergelist |
|
|
|
|
|
``` |
|
codellama/CodeLlama-34b-hf |
|
codellama/CodeLlama-34b-Instruct-hf |
|
allenai/codetulu-2-34b |
|
Phind/Phind-CodeLlama-34B-v1 |
|
Phind/Phind-CodeLlama-34B-Python-v1 |
|
uukuguy/speechless-codellama-34b-v2.0 |
|
codellama/CodeLlama-34b-Python-hf |
|
Phind/Phind-CodeLlama-34B-v2 |
|
``` |
|
|
|
These models failed to merge: |
|
``` |
|
pharaouk/unnatural_codellama_34B |
|
codefuse-ai/CodeFuse-CodeLlama-34B |
|
XAgentTeam/XAgentLLaMa-34B-preview |
|
``` |
|
|
|
## Merge command |
|
|
|
``` |
|
python3 hf_merge.py codellama.txt codellama -p 0.16 -lambda 2 |
|
``` |
|
|
