BAAI
/

Image-to-Text
PhyscalX commited on
Commit
73d068c
β€’
1 Parent(s): 3721d07

Update Readme

Browse files
Files changed (1) hide show
  1. README.md +12 -4
README.md CHANGED
@@ -27,10 +27,18 @@ See [Github Page](https://github.com/baaivision/tokenize-anything).
27
 
28
  Two versions of the model are available with different image encoders.
29
 
30
- | Model | Description | MD5 | Weights |
31
- | ----- | ------------| ----| ------ |
32
- | **tap_vit_l** | ViT-L TAP model | 03f8ec | [πŸ€— HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_l_03f8ec.pkl) |
33
- | **tap_vit_b** | ViT-B TAP model | b45cbf | [πŸ€— HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_b_b45cbf.pkl) |
 
 
 
 
 
 
 
 
34
 
35
  ### Concept weights
36
 
 
27
 
28
  Two versions of the model are available with different image encoders.
29
 
30
+ | Model | Description | Schedule | MD5 | Weights |
31
+ | ----- | ------------| ------ | ----| ------ |
32
+ | **tap_vit_l** | ViT-L TAP v1.1 model | (100% SA-1B, 180k), (VG, 50ep) | c1d41f | [πŸ€— HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_l_v1_1.pkl) |
33
+ | **tap_vit_b** | ViT-B TAP v1.1 model | (100% SA-1B, 180k), (VG, 50ep) | 707f80 | [πŸ€— HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_b_v1_1.pkl) |
34
+ | **tap_vit_l** | ViT-L TAP v1.0 model | (50% SA-1B, 90k), (VG, 25ep) | 03f8ec | [πŸ€— HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_l_v1_0.pkl) |
35
+ | **tap_vit_b** | ViT-B TAP v1.0 model | (50% SA-1B, 90k), (VG, 25ep) | b45cbf | [πŸ€— HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_b_v1_0.pkl) |
36
+
37
+ #### V1.1 Release Notes
38
+
39
+ - Use a longer pre-training and fine-tuning schedule (improved segmentation and caption performance).
40
+ - Apply weight decay for all bias parameters (avoid FP16 overflow in QK matmul).
41
+ - Sample point prompts from predicted mask instead of GT box during VG training.
42
 
43
  ### Concept weights
44