How do you add a linear layer to a pretrained model

by cassanof - opened Jun 27, 2023

Discussion

cassanof

BigCode org Jun 27, 2023

We added a linear layer as a token classification head on top of the encoder model

I read this and I'm very curious on how you would go about doing this. Any insight appreciated, thanks!

loubnabnl

BigCode org Jun 29, 2023

We use the AutoModelForTokenClassification class from transformers which adds the classification head to the base model, you can find the finetuning code here

loubnabnl changed discussion status to closed Jul 24, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment