Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,36 @@
|
|
1 |
---
|
2 |
license: mit
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
+
datasets:
|
4 |
+
- imagenet-1k
|
5 |
+
language:
|
6 |
+
- en
|
7 |
+
metrics:
|
8 |
+
- accuracy
|
9 |
+
pipeline_tag: image-classification
|
10 |
+
tags:
|
11 |
+
- code
|
12 |
---
|
13 |
+
# Matryoshka Representation Learning🪆
|
14 |
+
_Aditya Kusupati*, Gantavya Bhatt*, Aniket Rege*, Matthew Wallingford, Aditya Sinha, Vivek Ramanujan, William Howard-Snyder, Kaifeng Chen, Sham Kakade, Prateek Jain, Ali Farhadi_
|
15 |
+
|
16 |
+
GitHub: https://github.com/RAIVNLab/MRL
|
17 |
+
|
18 |
+
Arxiv: https://arxiv.org/abs/2205.13147
|
19 |
+
|
20 |
+
We provide pretrained models trained with [FFCV](https://github.com/libffcv/ffcv) on ImageNet-1K:
|
21 |
+
1. `mrl` : ResNet50 __mrl__ models trained with Matryoshka loss (vanilla and efficient) with nesting starting from _d=8_ (default) and _d=16_
|
22 |
+
2. `fixed-feature` : independently trained ResNet50 baselines at _log(d)_ granularities
|
23 |
+
3. `resnet-family` : __mrl__ and __ff__ models trained on ResNet18/34/101
|
24 |
+
|
25 |
+
## Citation
|
26 |
+
If you find this project useful in your research, please consider citing:
|
27 |
+
```
|
28 |
+
@inproceedings{kusupati2022matryoshka,
|
29 |
+
title = {Matryoshka Representation Learning},
|
30 |
+
author = {Kusupati, Aditya and Bhatt, Gantavya and Rege, Aniket and Wallingford, Matthew and Sinha, Aditya and Ramanujan, Vivek and Howard-Snyder, William and Chen, Kaifeng and Kakade, Sham and Jain, Prateek and others},
|
31 |
+
title = {Matryoshka Representation Learning.},
|
32 |
+
booktitle = {Advances in Neural Information Processing Systems},
|
33 |
+
month = {December},
|
34 |
+
year = {2022},
|
35 |
+
}
|
36 |
+
```
|