--- language: - da license: apache-2.0 --- ## daT5-base A smaller version of [Google's mt5-base](https://huggingface.co/google/mt5-base) model, where the original model is reduced to only include Danish embeddings. ## How to use ```python from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("emillykkejensen/daT5-base") model = AutoModel.from_pretrained("emillykkejensen/daT5-base") ``` ## Further reading [Gist](https://gist.github.com/emillykkejensen/8bf1b323495efc7252dee966e6bc1b5c) showing (in Danish) how the embeddings are extracted [Article](https://towardsdatascience.com/how-to-adapt-a-multilingual-t5-model-for-a-single-language-b9f94f3d9c90) explaining how to do it by [David Dale](https://huggingface.co/cointegrated) ## Also check out [daT5-large](https://huggingface.co/emillykkejensen/daT5-large)