Taishi-N324
commited on
Commit
•
429c270
1
Parent(s):
088afc8
Update README.md
Browse files
README.md
CHANGED
@@ -28,21 +28,13 @@ This repository provides large language models developed by [LLM-jp](https://llm
|
|
28 |
|
29 |
| Model Variant |
|
30 |
| :--- |
|
31 |
-
|**
|
32 |
-
| [llm-jp-13b-
|
33 |
-
| [llm-jp-13b-
|
34 |
-
| [llm-jp-
|
35 |
-
| [llm-jp-
|
36 |
-
| [llm-jp-13b-instruct-lora-jaster-dolly-oasst-v1.0](https://huggingface.co/llm-jp/llm-jp-13b-instruct-lora-jaster-dolly-oasst-v1.0) |
|
37 |
-
| [llm-jp-13b-instruct-lora-dolly-oasst-v1.0](https://huggingface.co/llm-jp/llm-jp-13b-instruct-lora-dolly-oasst-v1.0) |
|
38 |
|
39 |
-
|
40 |
-
| |
|
41 |
-
| :--- |
|
42 |
-
|**Pre-trained models**|
|
43 |
-
| [llm-jp-13b-v1.0](https://huggingface.co/llm-jp/llm-jp-13b-v1.0) |
|
44 |
-
| [llm-jp-1.3b-v1.0](https://huggingface.co/llm-jp/llm-jp-1.3b-v1.0) |
|
45 |
-
Checkpoints format: `transformers` (Megatron-DeepSpeed format available [here]())
|
46 |
|
47 |
|
48 |
## Required Libraries and Their Versions
|
|
|
28 |
|
29 |
| Model Variant |
|
30 |
| :--- |
|
31 |
+
|**Pre-trained models Megatron-DeepSpeed**|
|
32 |
+
| [llm-jp-13b-v1.0-mdsfmt](https://huggingface.co/llm-jp/llm-jp-13b-v1.0-mdsfmt) |
|
33 |
+
| [llm-jp-13b-v1.0-mdsfmt-itr87870](https://huggingface.co/llm-jp/llm-jp-13b-v1.0-mdsfmt-itr87870) |
|
34 |
+
| [llm-jp-1.3b-v1.0-mdsfmt](https://huggingface.co/llm-jp/llm-jp-1.3b-v1.0-mdsfmt) |
|
35 |
+
| [llm-jp-1.3b-v1.0-mdsfmt-itr87430](https://huggingface.co/llm-jp/llm-jp-1.3b-v1.0-mdsfmt-itr87430) |
|
|
|
|
|
36 |
|
37 |
+
Checkpoints format: `Megatron-DeepSpeed` (transformers format available [here]())
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
|
39 |
|
40 |
## Required Libraries and Their Versions
|