In this work we propose a technique that transfers supervision between images from different modalities. We use learned representations from a large labeled modality as supervisory signal for training representations for a new unlabeled paired modality. Our method enables learning of rich representations for unlabeled modalities and can be used as a pre-training procedure for new modalities with limited labeled data. We transfer supervision from labeled RGB images to unlabeled depth and optical flow images and demonstrate large improvements for both these cross modal supervision transfers.
To learn rich representations for the depth modality, REF transferred supervisions from labeled RGB images to unlabeled depth images.
Cross Modal Distillation for Supervision Transfer
2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Computer Science