Update README.md
Browse files
README.md
CHANGED
@@ -8,12 +8,7 @@ The is a 8x MoE version of [microsoft/Phi-3-mini-4k-instruct](https://huggingfac
|
|
8 |
It is based on the Llamafied version [vonjack/Phi-3-mini-4k-instruct-LLaMAfied](https://huggingface.co/vonjack/Phi-3-mini-4k-instruct-LLaMAfied) of
|
9 |
[Gan Feng](https://huggingface.co/vonjack).
|
10 |
|
11 |
-
It was created with the help of [mergekit](https://github.com/arcee-ai/mergekit)
|
12 |
-
[configuration](https://huggingface.co/PhilipMay/Phi-3-MoE-mini-4k-instruct-raw/blob/main/mergekit_moe_config.yml) and this command:
|
13 |
-
|
14 |
-
```bash
|
15 |
-
TODO
|
16 |
-
```
|
17 |
|
18 |
As the router was initialized randomly during merging, this is a raw model.
|
19 |
It should be trained before it can be used.
|
|
|
8 |
It is based on the Llamafied version [vonjack/Phi-3-mini-4k-instruct-LLaMAfied](https://huggingface.co/vonjack/Phi-3-mini-4k-instruct-LLaMAfied) of
|
9 |
[Gan Feng](https://huggingface.co/vonjack).
|
10 |
|
11 |
+
It was created with the help of [mergekit](https://github.com/arcee-ai/mergekit).
|
|
|
|
|
|
|
|
|
|
|
12 |
|
13 |
As the router was initialized randomly during merging, this is a raw model.
|
14 |
It should be trained before it can be used.
|