Plan to integrate NorBERT classes into `transformers`?

by saattrupdan - opened May 17, 2023

May 17, 2023

Hey! Thanks for training these models, they're working great 😊

I've integrated your modelling scripts into ScandEval and benchmarked all of the models, and your large model is currently the best Norwegian as well as Scandinavian model! Check it out at the leaderboard.

Do you have any plans to integrate your classes into the transformers package? If you need any help in this regard, I'd be happy to chip in.

davda54

Language Technology Group (University of Oslo) org May 23, 2023

Hi, thank you very much for making our models work with ScandEval! :)

I don't have any experience with integrating new model architectures into transformers, here is an open PR about this issue, I just have to find some time to work on it.

davda54

Language Technology Group (University of Oslo) org Jun 26, 2023

Hi @saattrupdan , the new NorBERT models can be loaded as AutoModels now :)

davda54 changed discussion status to closed Jun 26, 2023

saattrupdan

Jun 26, 2023

Hi @saattrupdan , the new NorBERT models can be loaded as AutoModels now :)

Perfect, thanks @davda54 ! 😀

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment