Plan to integrate NorBERT classes into `transformers`?

#1
by saattrupdan - opened

Hey! Thanks for training these models, they're working great 😊

I've integrated your modelling scripts into ScandEval and benchmarked all of the models, and your large model is currently the best Norwegian as well as Scandinavian model! Check it out at the leaderboard.

Do you have any plans to integrate your classes into the transformers package? If you need any help in this regard, I'd be happy to chip in.

Language Technology Group (University of Oslo) org

Hi, thank you very much for making our models work with ScandEval! :)

I don't have any experience with integrating new model architectures into transformers, here is an open PR about this issue, I just have to find some time to work on it.

Language Technology Group (University of Oslo) org

Hi @saattrupdan , the new NorBERT models can be loaded as AutoModels now :)

davda54 changed discussion status to closed

Hi @saattrupdan , the new NorBERT models can be loaded as AutoModels now :)

Perfect, thanks @davda54 ! πŸ˜€

Sign up or log in to comment