Crystalcareai
commited on
Commit
•
44c69ba
1
Parent(s):
77d1156
Update README.md
Browse files
README.md
CHANGED
@@ -28,7 +28,7 @@ Our appreciation for the sponsors of Dolphin 2.9:
|
|
28 |
|
29 |
This model utilizes PEFT layer replication at inference time to duplicate layers and increase parameter count. This works with both the merged model that comes stock with this repository,
|
30 |
and the adapter that is attached as well. Performance will be similar with both methods, but VRAM use is considerably less when using the adapter.
|
31 |
-
This model was initialized using [Unsloth's Mistralfied Phi-3-Instruct-4k](https://huggingface.co/unsloth/Phi-3-mini-4k-instruct). If you choose to use the adapter method, please attach it their model.
|
32 |
|
33 |
<img src="https://i.ibb.co/C6sqLBH/Vram-Use.png" width="300">
|
34 |
|
|
|
28 |
|
29 |
This model utilizes PEFT layer replication at inference time to duplicate layers and increase parameter count. This works with both the merged model that comes stock with this repository,
|
30 |
and the adapter that is attached as well. Performance will be similar with both methods, but VRAM use is considerably less when using the adapter.
|
31 |
+
This model was initialized using [Unsloth's Mistralfied Phi-3-Instruct-4k](https://huggingface.co/unsloth/Phi-3-mini-4k-instruct). If you choose to use the adapter method, please attach it to their model.
|
32 |
|
33 |
<img src="https://i.ibb.co/C6sqLBH/Vram-Use.png" width="300">
|
34 |
|