Before revision:  We explore architectures that combine state-of-the-art Transformer and ResNeXt modules fed into a  multimodal module to produce a combined model trained on many tasks.
After revision:  We design an architecture that combines state-of-the-art Transformer and ResNeXt modules fed into a multimodal module to produce a combined model trained on many tasks.