Update Readme
Browse files
README.md
CHANGED
@@ -27,10 +27,18 @@ See [Github Page](https://github.com/baaivision/tokenize-anything).
|
|
27 |
|
28 |
Two versions of the model are available with different image encoders.
|
29 |
|
30 |
-
| Model | Description | MD5 | Weights |
|
31 |
-
| ----- | ------------| ----| ------ |
|
32 |
-
| **tap_vit_l** | ViT-L TAP model |
|
33 |
-
| **tap_vit_b** | ViT-B TAP model |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
34 |
|
35 |
### Concept weights
|
36 |
|
|
|
27 |
|
28 |
Two versions of the model are available with different image encoders.
|
29 |
|
30 |
+
| Model | Description | Schedule | MD5 | Weights |
|
31 |
+
| ----- | ------------| ------ | ----| ------ |
|
32 |
+
| **tap_vit_l** | ViT-L TAP v1.1 model | (100% SA-1B, 180k), (VG, 50ep) | c1d41f | [π€ HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_l_v1_1.pkl) |
|
33 |
+
| **tap_vit_b** | ViT-B TAP v1.1 model | (100% SA-1B, 180k), (VG, 50ep) | 707f80 | [π€ HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_b_v1_1.pkl) |
|
34 |
+
| **tap_vit_l** | ViT-L TAP v1.0 model | (50% SA-1B, 90k), (VG, 25ep) | 03f8ec | [π€ HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_l_v1_0.pkl) |
|
35 |
+
| **tap_vit_b** | ViT-B TAP v1.0 model | (50% SA-1B, 90k), (VG, 25ep) | b45cbf | [π€ HF link](https://huggingface.co/BAAI/tokenize-anything/blob/main/models/tap_vit_b_v1_0.pkl) |
|
36 |
+
|
37 |
+
#### V1.1 Release Notes
|
38 |
+
|
39 |
+
- Use a longer pre-training and fine-tuning schedule (improved segmentation and caption performance).
|
40 |
+
- Apply weight decay for all bias parameters (avoid FP16 overflow in QK matmul).
|
41 |
+
- Sample point prompts from predicted mask instead of GT box during VG training.
|
42 |
|
43 |
### Concept weights
|
44 |
|