yesidcanoc
commited on
Commit
•
b0f6fc2
1
Parent(s):
3bc3692
Update README.md
Browse files
README.md
CHANGED
@@ -3,7 +3,9 @@ pipeline_tag: image-to-text
|
|
3 |
---
|
4 |
# Image captioning model
|
5 |
|
6 |
-
End-to-end Transformer based image captioning model, where both the encoder and decoder use standard pre-trained transformer architectures.
|
|
|
|
|
7 |
|
8 |
## Encoder
|
9 |
The encoder uses the pre-trained Swin transformer (Liu et al., 2021) that is a general-purpose backbone for computer vision. It outperforms ViT, DeiT and ResNe(X)t models at tasks such as image classification, object detection and semantic segmentation. The fact that this model is not pre-trained to be a 'narrow expert'--- a model pre-trained to perform a specific task e.g., image classification --- makes it a good candidate for fine-tuning on a downstream task.
|
|
|
3 |
---
|
4 |
# Image captioning model
|
5 |
|
6 |
+
End-to-end Transformer based image captioning model, where both the encoder and decoder use standard pre-trained transformer architectures.
|
7 |
+
|
8 |
+
### Repository: https://github.com/yesidc/image-captioning
|
9 |
|
10 |
## Encoder
|
11 |
The encoder uses the pre-trained Swin transformer (Liu et al., 2021) that is a general-purpose backbone for computer vision. It outperforms ViT, DeiT and ResNe(X)t models at tasks such as image classification, object detection and semantic segmentation. The fact that this model is not pre-trained to be a 'narrow expert'--- a model pre-trained to perform a specific task e.g., image classification --- makes it a good candidate for fine-tuning on a downstream task.
|