Jingjing Zhai
commited on
Commit
•
a19e0dd
1
Parent(s):
208dd61
Add links for each model in README
Browse files
README.md
CHANGED
|
@@ -6,10 +6,10 @@ license: apache-2.0
|
|
| 6 |
|
| 7 |
PlantCaduceus is a DNA language model pre-trained on 16 Angiosperm genomes. Utilizing the [Caduceus](https://caduceus-dna.github.io/) and [Mamba](https://arxiv.org/abs/2312.00752) architectures and a masked language modeling objective, PlantCaduceus is designed to learn evolutionary conservation and DNA sequence grammar from 16 species spanning a history of 160 million years. We have trained a series of PlantCaduceus models with varying parameter sizes:
|
| 8 |
|
| 9 |
-
- **PlantCaduceus_l20**: 20 layers, 384 hidden size, 20M parameters
|
| 10 |
-
- **PlantCaduceus_l24**: 24 layers, 512 hidden size, 40M parameters
|
| 11 |
-
- **PlantCaduceus_l28**: 28 layers, 768 hidden size, 112M parameters
|
| 12 |
-
- **PlantCaduceus_l32**: 32 layers, 1024 hidden size, 225M parameters
|
| 13 |
|
| 14 |
## How to use
|
| 15 |
```python
|
|
|
|
| 6 |
|
| 7 |
PlantCaduceus is a DNA language model pre-trained on 16 Angiosperm genomes. Utilizing the [Caduceus](https://caduceus-dna.github.io/) and [Mamba](https://arxiv.org/abs/2312.00752) architectures and a masked language modeling objective, PlantCaduceus is designed to learn evolutionary conservation and DNA sequence grammar from 16 species spanning a history of 160 million years. We have trained a series of PlantCaduceus models with varying parameter sizes:
|
| 8 |
|
| 9 |
+
- **[PlantCaduceus_l20](https://huggingface.co/kuleshov-group/PlantCaduceus_l20)**: 20 layers, 384 hidden size, 20M parameters
|
| 10 |
+
- **[PlantCaduceus_l24](https://huggingface.co/kuleshov-group/PlantCaduceus_l24)**: 24 layers, 512 hidden size, 40M parameters
|
| 11 |
+
- **[PlantCaduceus_l28](https://huggingface.co/kuleshov-group/PlantCaduceus_l28)**: 28 layers, 768 hidden size, 112M parameters
|
| 12 |
+
- **[PlantCaduceus_l32](https://huggingface.co/kuleshov-group/PlantCaduceus_l32)**: 32 layers, 1024 hidden size, 225M parameters
|
| 13 |
|
| 14 |
## How to use
|
| 15 |
```python
|