Edit model card

Tensorflow Keras Implementation of Multimodal entailment.

This repo contains the models Multimodal Entailment.

Credits: Sayak Paul - Original Author

HF Contribution: Rishav Chandra Varma

Background Information


In this example, we will build and train a model for predicting multimodal entailment. We will be using the multimodal entailment dataset recently introduced by Google Research.

What is multimodal entailment?

On social media platforms, to audit and moderate content we may want to find answers to the following questions in near real-time:

Does a given piece of information contradict the other?
Does a given piece of information imply the other?

In NLP, this task is called analyzing textual entailment. However, that's only when the information comes from text content. In practice, it's often the case the information available comes not just from text content, but from a multimodal combination of text, images, audio, video, etc. Multimodal entailment is simply the extension of textual entailment to a variety of new input modalities.

Downloads last month
Hosted inference API

Unable to determine this model’s pipeline type. Check the docs .

Spaces using keras-io/multimodal-entailment 3