---
language:
- en
tags:
- align
- clip
license: apache-2.0
datasets:
- kakaobrain/coyo-700m
inference: false
---

# Model Details

This is an unofficial implementation of [ALIGN](https://arxiv.org/abs/2102.05918) trained on [COYO-700M](https://github.com/kakaobrain/coyo-dataset). The official ALIGN is trained on its dataset of 1.8B samples. That dataset is not released to the public. Instead, we trained our implementation of ALIGN model on [COYO-700M](https://github.com/kakaobrain/coyo-dataset).

It's developed by Kakao Brain to validate the performance of COYO-700M dataset on a large-scale model.

The training took about 8 days on TPU V3-512.

## Model Date

April 2022

## Model Type

This is dual encoder model where
- image encoder is using EfficientNet-B7 architecture
- text encoder is using BERT-base architecture

# Training data

This model is trained on [COYO-700M](https://github.com/kakaobrain/coyo-dataset) dataset.

# Evaluation results

|                                  |  Dataset   | ImageNet | Flickr30k |         | MsCOCO  |         |
|----------------------------------|:----------:|:--------:|:---------:|:-------:|:-------:|:-------:|
|                                  |            |   KNN    |  I2T R@1  | T2I R@1 | I2T R@1 | T2I R@1 |
| ALIGN-L2-Large(Google)           | ALIGN 1.8B |   76.4   |   88.6    |  75.7   |  58.6   |  45.6   |
| ALIGN-B7-Base(Google)            | ALIGN 1.8B |   69.3   |     -     |    -    |  55.4   |  41.7   |
| COYO-ALIGN-B7-Base(Kakao Brain)  | COYO-700M  |   68.6   |   88.1    |  73.2   |  61.2   |  43.1   |