MaziyarPanahi
commited on
Commit
•
d7a439c
1
Parent(s):
a19262f
Update README.md
Browse files
README.md
CHANGED
@@ -6,4 +6,6 @@ tags:
|
|
6 |
- merge
|
7 |
---
|
8 |
|
9 |
-
Merge of top 7B models with DARE method
|
|
|
|
|
|
6 |
- merge
|
7 |
---
|
8 |
|
9 |
+
Merge of top 7B models with DARE method
|
10 |
+
|
11 |
+
> mergekit is a toolkit for merging pre-trained language models. mergekit uses an out-of-core approach to perform unreasonably elaborate merges in resource-constrained situations. Merges can be run entirely on CPU or accelerated with as little as 8 GB of VRAM. Many merging algorithms are supported, with more coming as they catch my attention.
|