RaphaelMourad commited on
Commit
ab27bae
1 Parent(s): 1213639

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -8,9 +8,9 @@ tags:
8
  - genomics
9
  ---
10
 
11
- # Model Card for mixtral-dna-yeast-v0.2 (mistral for DNA)
12
 
13
- The mixtral-dna-yeast-v0.2 Large Language Model (LLM) is a pretrained generative DNA text model with 17.31M parameters x 8 experts = 138.5M parameters.
14
  It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
15
  The model was pretrained using around 1000 yeast genomes with 10kb DNA sequences.
16
 
@@ -31,8 +31,8 @@ Like Mistral-7B-v0.1, it is a transformer model, with the following architecture
31
  import torch
32
  from transformers import AutoTokenizer, AutoModel
33
 
34
- tokenizer = AutoTokenizer.from_pretrained("RaphaelMourad/mixtral-dna-yeast-v0.2", trust_remote_code=True) # Same as DNABERT2
35
- model = AutoModel.from_pretrained("RaphaelMourad/mixtral-dna-yeast-v0.2", trust_remote_code=True)
36
  ```
37
 
38
  ## Calculate the embedding of a DNA sequence
@@ -53,7 +53,7 @@ Ensure you are utilizing a stable version of Transformers, 4.34.0 or newer.
53
 
54
  ## Notice
55
 
56
- Mistral-DNA is a pretrained base model for DNA.
57
 
58
  ## Contact
59
 
 
8
  - genomics
9
  ---
10
 
11
+ # Model Card for Mistral-DNA-v1-138M-yeast (mistral for DNA)
12
 
13
+ The Mistral-DNA-v1-138M-yeast Large Language Model (LLM) is a pretrained generative DNA text model with 17.31M parameters x 8 experts = 138.5M parameters.
14
  It is derived from Mistral-7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
15
  The model was pretrained using around 1000 yeast genomes with 10kb DNA sequences.
16
 
 
31
  import torch
32
  from transformers import AutoTokenizer, AutoModel
33
 
34
+ tokenizer = AutoTokenizer.from_pretrained("RaphaelMourad/Mistral-DNA-v1-138M-yeast", trust_remote_code=True) # Same as DNABERT2
35
+ model = AutoModel.from_pretrained("RaphaelMourad/Mistral-DNA-v1-138M-yeast", trust_remote_code=True)
36
  ```
37
 
38
  ## Calculate the embedding of a DNA sequence
 
53
 
54
  ## Notice
55
 
56
+ Mistral-DNA-v1-138M-yeast is a pretrained base model for DNA.
57
 
58
  ## Contact
59