Hugging Face's logo

distilbert
/
distilbert-base-uncased-finetuned-sst-2-english

Text Classification Transformers PyTorch TensorFlow Rust ONNX Safetensors
English
distilbert Eval Results Inference Endpoints
Model card Files Community
32

Where can I find the prediction head training code?

#10
by ethanjyx - opened
Discussion
ethanjyx

My understanding is this model is using BERT as the backbone and then have a prediction head for the text classification card.

Where can I find the prediction head code? I didn't see it in the "Files and Versions" tab.

Thanks!

fxmarty

Do you mean this https://github.com/huggingface/transformers/blob/71fc33174664738d8c8d93025ebc810180e69c20/src/transformers/models/distilbert/modeling_distilbert.py#L695 ?

Sign up or log in to comment