distilbert-base-uncased-agnews-student

Model Description

This model is distilled from the zero-shot classification pipeline on the unlabeled AG's News dataset using this script. It is the result of the demo notebook here, where more details about the model can be found.

Intended Usage

The model can be used like any other model trained on AG's News, but will likely not perform as well as a model trained with full supervision. It is primarily intended as a demo of how an expensive NLI-based zero-shot model can be distilled to a more efficient student.

Downloads last month
64
Hosted inference API
Text Classification
This model can be loaded on the Inference API on-demand.