Commit
•
6b2c108
1
Parent(s):
9525981
Update README.md
Browse files
README.md
CHANGED
|
@@ -13,6 +13,7 @@ AIDO.RNA is an encoder-only transformer and is pre-trained using masked language
|
|
| 13 |
| hidden-size | 2,048 |
|
| 14 |
| ffn-hidden-size | 5,440 |
|
| 15 |
| num-attn-heads | 32 |
|
|
|
|
| 16 |
|
| 17 |
|
| 18 |
## Pre-training data
|
|
|
|
| 13 |
| hidden-size | 2,048 |
|
| 14 |
| ffn-hidden-size | 5,440 |
|
| 15 |
| num-attn-heads | 32 |
|
| 16 |
+
| vocab-size | 16 |
|
| 17 |
|
| 18 |
|
| 19 |
## Pre-training data
|