Sennodipoi/LayoutLMv3-kleisterNDA · Add Kleister NDA performance metrics

Oct 24, 2022

Hey Allesandro ☺️,

very cool thesis project and thanks for making all the code publically available!
It would be great, if you could make the performance metrics available, e.g., by putting it in the model card like Niels did.

That would be awesome!

Sennodipoi

Owner Oct 25, 2022

Hi Malte, glad to know that people are interested in this :)

You're definitely right, I should put more info in the model cards. I'm planning to update them all after my thesis defense.

In the meanwhile, if you are interested in LayoutLMv3 for Kleister-NDA, I was able to reach a f1 score of 0,94 using the same segmentation strategy used by the original authors for FUNSD i.e. using labels to create segments. However, in the case of Kleister-NDA I believe that this strategy significantly helps the model and thus it severely impacts the evaluation of the model.

Sennodipoi

Owner Oct 27, 2022

Hi, I added the resultsfor all the LayoutLM models.

Cheers,
Alessandro

Sennodipoi changed discussion status to closed Oct 27, 2022