Hugging Face's logo

robvanderg
/
Sem-mmmBERT

Feature Extraction
Transformers
PyTorch
multilingual
bert
STILT
retraining
multi-task learning
text-embeddings-inference
Inference Endpoints
Model card Files Community
YAML Metadata Error: "datasets[0]" with value "SemEval 2022" is not valid. If possible, use a dataset id from https://hf.co/datasets.

Sem-mmmBERT

This is the SemEval MaChAmp Multitask Multilingual BERT model. This model is retrained from mBERT (https://huggingface.co/bert-base-multilingual-cased).

The retraining is done based on all SemEval 2022 tasks that are text based, and have annotation on the word, sentence or paragraph level. The retraining is done with MaChAmp (https://machamp-nlp.github.io/), a toolkit focusing on multi-task learning for NLP. More information can be found in the paper (which should be released when the SemEval proceedings are online).

Downloads last month
37
Inference Examples
Feature Extraction
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.