Add evaluation results on scientific_papers dataset
Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!
Your model has been evaluated on the scientific_papers dataset by @Blaise_g, using the predictions stored here.
Accept this pull request to see the results displayed on the Hub leaderboard.
Evaluate your model on more datasets here.
This is the 5th PR that is opened here - why open so many PRs?
Also it's evaluated on the wrong config - it should have been evaluated on arxiv not on pubmed cc @lewtun
Ups I accidentally merged it now - well guess it's ok to also have eval metrics on another dataset it has been trained on
Yeah I think it's actually fine for summarization models to be evaluated on datasets they weren't trained on. Regarding the duplicate PRs, it's something we're looking into - see https://huggingface.co/google/bigbird-pegasus-large-pubmed/discussions/3#62bcb8fa2f61a029a01d4038