Before revision:  We explore architectures that combine state-of-the-art Transformer and ResNeXt modules fed into a  multimodal module to produce a combined model trained on many tasks.
After revision:  We explore architectures that combine state-of-the-art Transformer and ResNeXt modules fed into a novel attentive multimodal module to produce a combined model trained on many tasks.