Commit
•
7a947ca
1
Parent(s):
6508036
Update README.md
Browse files
README.md
CHANGED
|
@@ -8,6 +8,7 @@ tags:
|
|
| 8 |
|
| 9 |
The Mistral-DNA-v0.1 Large Language Model (LLM) is a pretrained generative DNA text model with 164K parameters x 64 experts = 105M parameters.
|
| 10 |
It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
|
|
|
|
| 11 |
This version v0.1 of Mistral-DNA corresponds to a pretty simple model, which was primarly designed low computational resources (the aim was not to get the best accuracy results).
|
| 12 |
|
| 13 |
For full details of this model please read our [github repo](https://github.com/raphaelmourad/Mistral-DNA).
|
|
|
|
| 8 |
|
| 9 |
The Mistral-DNA-v0.1 Large Language Model (LLM) is a pretrained generative DNA text model with 164K parameters x 64 experts = 105M parameters.
|
| 10 |
It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
|
| 11 |
+
The model was pretrained using the human genome hg38 with 200b DNA sequences.
|
| 12 |
This version v0.1 of Mistral-DNA corresponds to a pretty simple model, which was primarly designed low computational resources (the aim was not to get the best accuracy results).
|
| 13 |
|
| 14 |
For full details of this model please read our [github repo](https://github.com/raphaelmourad/Mistral-DNA).
|