Commit
•
fe83d7d
1
Parent(s):
3495c1e
Update README.md
Browse files
README.md
CHANGED
@@ -6,10 +6,10 @@ tags:
|
|
6 |
|
7 |
# Model Card for Mistral-DNA-v0.1
|
8 |
|
9 |
-
The Mistral-DNA-v0.1 Large Language Model (LLM) is a pretrained generative DNA text model with
|
10 |
It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
|
11 |
The model was pretrained using the human genome hg38 with 200b DNA sequences.
|
12 |
-
This version v0.1 of Mistral-DNA corresponds to a pretty simple model, which was primarly designed low computational resources (the aim was not to get the best accuracy results).
|
13 |
|
14 |
For full details of this model please read our [github repo](https://github.com/raphaelmourad/Mistral-DNA).
|
15 |
|
|
|
6 |
|
7 |
# Model Card for Mistral-DNA-v0.1
|
8 |
|
9 |
+
The Mistral-DNA-v0.1 Large Language Model (LLM) is a pretrained generative DNA text model with 1.64M parameters x 64 experts = 105M parameters.
|
10 |
It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
|
11 |
The model was pretrained using the human genome hg38 with 200b DNA sequences.
|
12 |
+
This version v0.1 of Mistral-DNA corresponds to a pretty simple model, which was primarly designed for low computational resources (the aim was not to get the best accuracy results).
|
13 |
|
14 |
For full details of this model please read our [github repo](https://github.com/raphaelmourad/Mistral-DNA).
|
15 |
|