MariamWael
commited on
Commit
•
a3d67a2
1
Parent(s):
63d2082
Upload folder using huggingface_hub
Browse files- README.md +30 -0
- model-1.safetensors +3 -0
- model-2.safetensors +3 -0
- model-3.safetensors +3 -0
- model-4.safetensors +3 -0
README.md
ADDED
@@ -0,0 +1,30 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
tags:
|
4 |
+
- merge
|
5 |
+
- mergekit
|
6 |
+
- lazymergekit
|
7 |
+
- OpenPipe/mistral-ft-optimized-1218
|
8 |
+
- mlabonne/NeuralHermes-2.5-Mistral-7B
|
9 |
+
---
|
10 |
+
|
11 |
+
# NeuralPipe-9B-merged
|
12 |
+
|
13 |
+
NeuralPipe-9B-merged is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
|
14 |
+
* [OpenPipe/mistral-ft-optimized-1218](https://huggingface.co/OpenPipe/mistral-ft-optimized-1218)
|
15 |
+
* [mlabonne/NeuralHermes-2.5-Mistral-7B](https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B)
|
16 |
+
|
17 |
+
## 🧩 Configuration
|
18 |
+
|
19 |
+
```yaml
|
20 |
+
slices:
|
21 |
+
- sources:
|
22 |
+
- model: OpenPipe/mistral-ft-optimized-1218
|
23 |
+
layer_range: [0, 32]
|
24 |
+
- sources:
|
25 |
+
- model: mlabonne/NeuralHermes-2.5-Mistral-7B
|
26 |
+
layer_range: [24, 32]
|
27 |
+
merge_method: passthrough
|
28 |
+
dtype: bfloat16
|
29 |
+
|
30 |
+
```
|
model-1.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:46200cfe67ce2a05229022a20595b25022fb62b446aa436c4e9e06ab096a140c
|
3 |
+
size 1946227376
|
model-2.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b3cc0f761e85e4c90053d01385284d43043cbfc63aea1adcf095d21afc83467e
|
3 |
+
size 1979789776
|
model-3.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:de55ee8985b8b6db2f2b515b2bc26c40b489b68b86076057ed058abc4091d8d8
|
3 |
+
size 1946235664
|
model-4.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:eb1a9f305907cea3d4e9ce5304f67d95903983f107c044c7959437a486fd6548
|
3 |
+
size 1979789736
|