LongformerPreTrainedModel
#1
by
karol-saputa
- opened
Is it possible to use this model as LongformerPreTrainedModel in fine-tuning e.g. for token classification ?
Should be possible. Initialize the model using AutoModelForTokenClassification and then fine-tuned it on your dataset.
from transformers import AutoModelForTokenClassification
model = AutoModelForTokenClassification.from_pretrained("sdadas/polish-longformer-large-4096")
sdadas
changed discussion status to
closed