--- tags: - bert - adapter-transformers - fill-mask - adapterhub:vi/wiki language: - vi license: "apache-2.0" --- # Adapter `bert-base-multilingual-cased_vi_wiki_pfeiffer` for bert-base-multilingual-cased An adapter for the `bert-base-multilingual-cased` model, trained on the [vi/wiki](https://adapterhub.ml/explore/vi/wiki/) dataset and includes a prediction head for masked lm. **This adapter was created for usage with the [Adapters](https://github.com/Adapter-Hub/adapters) library.** ## Usage First, install `adapters`: ``` pip install -U adapters ``` Now, the adapter can be loaded and activated like this: ```python from adapters import AutoAdapterModel model = AutoAdapterModel.from_pretrained("bert-base-multilingual-cased") adapter_name = model.load_adapter("AdapterHub/bert-base-multilingual-cased_vi_wiki_pfeiffer") model.set_active_adapters(adapter_name) ``` ## Architecture & Training - Adapter architecture: pfeiffer - Prediction head: masked lm - Dataset: [vi/wiki](https://adapterhub.ml/explore/vi/wiki/) ## Author Information - Author name(s): Jonas Pfeiffer - Author email: Jonas@Pfeiffer.ai - Author links: [Website](https://pfeiffer.ai), [GitHub](https://github.com/JoPfeiff), [Twitter](https://twitter.com/@PfeiffJo) ## Citation ```bibtex @inproceedings{pfeiffer20madx, title = "{MAD-X}: {A}n {A}dapter-{B}ased {F}ramework for {M}ulti-{T}ask {C}ross-{L}ingual {T}ransfer", author = "Pfeiffer, Jonas and Vuli{\'c}, Ivan and Gurevych, Iryna and Ruder, Sebastian", booktitle = "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)", year = "2020", address = "Online", publisher = "Association for Computational Linguistics", url = "https://www.aclweb.org/anthology/2020.emnlp-main.617", pages = "7654--7673", } ``` *This adapter has been auto-imported from https://github.com/Adapter-Hub/Hub/blob/master/adapters/ukp/bert-base-multilingual-cased_vi_wiki_pfeiffer.yaml*.