File size: 848 Bytes
7044336
 
476effa
 
 
 
 
 
 
 
 
 
17ad5f5
7044336
476effa
 
 
 
 
 
 
 
 
 
 
 
 
 
8d98d93
 
476effa
 
 
 
 
 
 
 
 
 
 
 
 
8d98d93
476effa
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
---
license: llama2
language:
- en
pipeline_tag: text-generation
inference: false
tags:
- dare
- super mario merge
- pytorch
- llama
- codellama
- merge
---

# codellama 34b mega merge

The following were merged with DARE using [https://github.com/martyn/safetensors-merge-supermario](https://github.com/martyn/safetensors-merge-supermario)

## Mergelist


```
codellama/CodeLlama-34b-hf
codellama/CodeLlama-34b-Instruct-hf
allenai/codetulu-2-34b
Phind/Phind-CodeLlama-34B-v1
Phind/Phind-CodeLlama-34B-Python-v1
uukuguy/speechless-codellama-34b-v2.0
codellama/CodeLlama-34b-Python-hf
Phind/Phind-CodeLlama-34B-v2
```

These models failed to merge:
```
pharaouk/unnatural_codellama_34B
codefuse-ai/CodeFuse-CodeLlama-34B
XAgentTeam/XAgentLLaMa-34B-preview
```

## Merge command

```
python3 hf_merge.py codellama.txt codellama -p 0.16 -lambda 2
```