RaphaelMourad
commited on
Commit
•
ab27bae
1
Parent(s):
1213639
Update README.md
Browse files
README.md
CHANGED
@@ -8,9 +8,9 @@ tags:
|
|
8 |
- genomics
|
9 |
---
|
10 |
|
11 |
-
# Model Card for
|
12 |
|
13 |
-
The
|
14 |
It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
|
15 |
The model was pretrained using around 1000 yeast genomes with 10kb DNA sequences.
|
16 |
|
@@ -31,8 +31,8 @@ Like Mistral-7B-v0.1, it is a transformer model, with the following architecture
|
|
31 |
import torch
|
32 |
from transformers import AutoTokenizer, AutoModel
|
33 |
|
34 |
-
tokenizer = AutoTokenizer.from_pretrained("RaphaelMourad/
|
35 |
-
model = AutoModel.from_pretrained("RaphaelMourad/
|
36 |
```
|
37 |
|
38 |
## Calculate the embedding of a DNA sequence
|
@@ -53,7 +53,7 @@ Ensure you are utilizing a stable version of Transformers, 4.34.0 or newer.
|
|
53 |
|
54 |
## Notice
|
55 |
|
56 |
-
Mistral-DNA is a pretrained base model for DNA.
|
57 |
|
58 |
## Contact
|
59 |
|
|
|
8 |
- genomics
|
9 |
---
|
10 |
|
11 |
+
# Model Card for Mistral-DNA-v1-138M-yeast (mistral for DNA)
|
12 |
|
13 |
+
The Mistral-DNA-v1-138M-yeast Large Language Model (LLM) is a pretrained generative DNA text model with 17.31M parameters x 8 experts = 138.5M parameters.
|
14 |
It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
|
15 |
The model was pretrained using around 1000 yeast genomes with 10kb DNA sequences.
|
16 |
|
|
|
31 |
import torch
|
32 |
from transformers import AutoTokenizer, AutoModel
|
33 |
|
34 |
+
tokenizer = AutoTokenizer.from_pretrained("RaphaelMourad/Mistral-DNA-v1-138M-yeast", trust_remote_code=True) # Same as DNABERT2
|
35 |
+
model = AutoModel.from_pretrained("RaphaelMourad/Mistral-DNA-v1-138M-yeast", trust_remote_code=True)
|
36 |
```
|
37 |
|
38 |
## Calculate the embedding of a DNA sequence
|
|
|
53 |
|
54 |
## Notice
|
55 |
|
56 |
+
Mistral-DNA-v1-138M-yeast is a pretrained base model for DNA.
|
57 |
|
58 |
## Contact
|
59 |
|