Commit
•
32e910a
1
Parent(s):
9158a8d
Update README.md
Browse files
README.md
CHANGED
|
@@ -20,6 +20,8 @@ We provide five weights of bGPT on [Hugging Face](https://huggingface.co/sander-
|
|
| 20 |
4. **_weights-image.pth_**: bGPT pre-trained on ImageNet for image generation/classification (`.bmp`).
|
| 21 |
5. **_weights-audio.pth_**: bGPT pre-trained on Librispeech for audio generation/classification (`.wav`).
|
| 22 |
|
|
|
|
|
|
|
| 23 |
The code for bGPT is available on [GitHub ](https://github.com/sanderwood/bgpt).
|
| 24 |
|
| 25 |
## Installation
|
|
|
|
| 20 |
4. **_weights-image.pth_**: bGPT pre-trained on ImageNet for image generation/classification (`.bmp`).
|
| 21 |
5. **_weights-audio.pth_**: bGPT pre-trained on Librispeech for audio generation/classification (`.wav`).
|
| 22 |
|
| 23 |
+
The core components of bGPT include a 12-layer patch-level decoder, a 3-layer byte-level decoder, with a hidden size of 768, totaling 110 million parameters.
|
| 24 |
+
|
| 25 |
The code for bGPT is available on [GitHub ](https://github.com/sanderwood/bgpt).
|
| 26 |
|
| 27 |
## Installation
|