Update README.md
Browse files
README.md
CHANGED
|
@@ -34,6 +34,7 @@ ai](mailto:contact@eleuther.ai).
|
|
| 34 |
| n<sub>encoder layers</sub> | 12 |
|
| 35 |
| n<sub>decoder layers</sub> | 12 |
|
| 36 |
| d<sub>model</sub> | 2048 |
|
|
|
|
| 37 |
| n<sub>heads</sub> | 12 |
|
| 38 |
| d<sub>head</sub> | 64 |
|
| 39 |
| n<sub>vocab</sub> | 32128 |
|
|
|
|
| 34 |
| n<sub>encoder layers</sub> | 12 |
|
| 35 |
| n<sub>decoder layers</sub> | 12 |
|
| 36 |
| d<sub>model</sub> | 2048 |
|
| 37 |
+
| d<sub>emb</sub> | 768 |
|
| 38 |
| n<sub>heads</sub> | 12 |
|
| 39 |
| d<sub>head</sub> | 64 |
|
| 40 |
| n<sub>vocab</sub> | 32128 |
|