Longformer 8192
Longformer model with 8192 tokens sequence length. Initialized from FaceboookAI/roberta-base. No additional pre-training has been done.
Model can be loaded and run using AutoModel and AutoTokenizer.
- Downloads last month
- 2
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for capemox/longformer-8192
Base model
FacebookAI/roberta-base