Update README.md
Browse files
README.md
CHANGED
|
@@ -8,11 +8,9 @@ tags:
|
|
| 8 |
- merge
|
| 9 |
|
| 10 |
---
|
| 11 |
-
|
|
|
|
| 12 |
|
| 13 |
-
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
| 14 |
-
|
| 15 |
-
## Merge Details
|
| 16 |
### Merge Method
|
| 17 |
|
| 18 |
This model was merged using the SLERP merge method.
|
|
@@ -59,3 +57,7 @@ parameters:
|
|
| 59 |
- value: 0.5
|
| 60 |
dtype: bfloat16
|
| 61 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
- merge
|
| 9 |
|
| 10 |
---
|
| 11 |
+
## L-MChat-Small
|
| 12 |
+
This was a test of mine how small merges perform, because there are a lot of 7b merges and higher but not a lot of 2b merges.
|
| 13 |
|
|
|
|
|
|
|
|
|
|
| 14 |
### Merge Method
|
| 15 |
|
| 16 |
This model was merged using the SLERP merge method.
|
|
|
|
| 57 |
- value: 0.5
|
| 58 |
dtype: bfloat16
|
| 59 |
```
|
| 60 |
+
|
| 61 |
+
## Usage
|
| 62 |
+
|
| 63 |
+
Use it with the ChatML format, you can also use the Inference-API for this Model.
|