Update README.md
Browse files
README.md
CHANGED
|
@@ -29,8 +29,8 @@ tags:
|
|
| 29 |
|
| 30 |
# DiscoLM 70b
|
| 31 |
|
| 32 |
-
**DiscoLM 70b** is a 70b model based on [Laion's LeoLM 70b](https://huggingface.co/LeoLM/leo-hessianai-70b) which underwent additional continued
|
| 33 |
-
text, strengthening it's multilingual capabilities while retaining (
|
| 34 |
This was then further finetuned on a combination of some the most popular open-source instruction sets.
|
| 35 |
DiscoLM 70b is a [DiscoResearch](https://huggingface.co/DiscoResearch) project and was trained by [Björn Plüster](https://huggingface.co/bjoernp).
|
| 36 |
|
|
|
|
| 29 |
|
| 30 |
# DiscoLM 70b
|
| 31 |
|
| 32 |
+
**DiscoLM 70b** is a 70b model based on [Laion's LeoLM 70b](https://huggingface.co/LeoLM/leo-hessianai-70b) which underwent additional continued pretraining for 65b tokens of German
|
| 33 |
+
text, strengthening it's multilingual capabilities while retaining (and partially improving) English capabilities.
|
| 34 |
This was then further finetuned on a combination of some the most popular open-source instruction sets.
|
| 35 |
DiscoLM 70b is a [DiscoResearch](https://huggingface.co/DiscoResearch) project and was trained by [Björn Plüster](https://huggingface.co/bjoernp).
|
| 36 |
|