OpenNLPLab
commited on
Commit
•
a227b70
1
Parent(s):
f9d2fad
Update README.md
Browse files
README.md
CHANGED
@@ -46,7 +46,7 @@ This official repo introduces the TransNormerLLM model, featuring its open-sourc
|
|
46 |
- **TransNormerLLM2** also utilizes Simple GLU in the channel mixer, GLA in the token mixer, and SRMSNorm for normalization. However, in this version, the channel and token mixers operate concurrently, in parallel.
|
47 |
|
48 |
<p align="left">
|
49 |
-
<img src="./images/TransNormer1-2Arch.jpg" width="
|
50 |
</p>
|
51 |
|
52 |
# Released Weights
|
@@ -191,6 +191,6 @@ If you wish to cite our work, please use the following reference:
|
|
191 |
```
|
192 |
|
193 |
<p align="center">
|
194 |
-
<img src="./images/lightning-leopard.jpg" width="
|
195 |
- OpenNLPLab @2024 -
|
196 |
</p>
|
|
|
46 |
- **TransNormerLLM2** also utilizes Simple GLU in the channel mixer, GLA in the token mixer, and SRMSNorm for normalization. However, in this version, the channel and token mixers operate concurrently, in parallel.
|
47 |
|
48 |
<p align="left">
|
49 |
+
<img src="./images/TransNormer1-2Arch.jpg" width="80%" />
|
50 |
</p>
|
51 |
|
52 |
# Released Weights
|
|
|
191 |
```
|
192 |
|
193 |
<p align="center">
|
194 |
+
<img src="./images/lightning-leopard.jpg" width="60%" />
|
195 |
- OpenNLPLab @2024 -
|
196 |
</p>
|