bgyoon commited on
Commit
d1875f9
1 Parent(s): ddaddb7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -12,11 +12,11 @@ inference: false
12
 
13
  # Model Details
14
 
15
- This is an implementation of [ALIGN](https://arxiv.org/abs/2102.05918) trained on [COYO-700M](https://github.com/kakaobrain/coyo-dataset). The official ALIGN is trained on its dataset of 1.8B samples. That dataset is not released to the public. Instead, we trained our implementation of ALIGN model on [COYO-700M](https://github.com/kakaobrain/coyo-dataset).
16
 
17
  It's developed by Kakao Brain to validate the performance of COYO-700M dataset on a large-scale model.
18
 
19
- The training took about 10 days on V3-1024 with batch_size=64k.
20
 
21
  ## Model Date
22
 
 
12
 
13
  # Model Details
14
 
15
+ This is an unofficial implementation of [ALIGN](https://arxiv.org/abs/2102.05918) trained on [COYO-700M](https://github.com/kakaobrain/coyo-dataset). The official ALIGN is trained on its dataset of 1.8B samples. That dataset is not released to the public. Instead, we trained our implementation of ALIGN model on [COYO-700M](https://github.com/kakaobrain/coyo-dataset).
16
 
17
  It's developed by Kakao Brain to validate the performance of COYO-700M dataset on a large-scale model.
18
 
19
+ The training took about 10 days on TPU V3-1024 with `batch_size=64k`.
20
 
21
  ## Model Date
22