Add glue dataset tag

#4
by lewtun HF staff - opened

This allows this model to be evaluated alongside the other glue subsets in AutoTrain Evaluate

DistilBERT community org
edited Jun 27, 2022

BTW we now have sst2 as a separate dataset hf.co/datasets/sst2 does it not work with it?

julien-c changed pull request status to merged

Unfortunately that dataset treats the labels as [-1,1] instead of [0,1], which isn't supported in AutoTrain Evaluate yet: https://huggingface.co/datasets/sst2/blob/main/sst2.py#L104

Here's an (internal) issue to track: https://github.com/huggingface/autonlp-backend/issues/596

Sign up or log in to comment