Before revision:  Our method relies on 1 ) a cross-lingual auto-encoding , which learns the scene graph mapping function along with the scene graph encoders and sentence decoders on machine translation parallel corpora, and 2 ) an unsupervised feature mapping, which seeks to map the encoded scene graph features from image modality to sentence modality. By leveraging cross-lingual auto-encoding, cross-modal feature mapping, and adversarial learning, our method can learn an image captioner to generate captions in different languages.
After revision:  Our method relies on 1 ) a cross-lingual auto-encoding , which learns the scene graph mapping function along with the scene graph encoders and sentence decoders on machine translation parallel corpora, and 2 ) an unsupervised feature mapping, which seeks to map the encoded scene graph features from image modality to language modality.