Spaces:
Running
on
CPU Upgrade
remove jondurbin/airoboros-l2-70b-2.1
I need to re-submit this model. For some reason, it often injects BOS tokens after apostraphes. I'm also highly suspicious of the truthful QA score so I want to comb through the dataset again to make sure it's not contaminated.
Hi!
Just removed your model from the requests/results datasets, it can take up to an hour for the changes to propagate :)
Thank you for being careful about this!
Hi there, looks like the leaderboard might have the old cached result here (and a duplicate with the re-uploaded version).
The original version, which I removed here, had some overlaps with truthfulqa from synthetic data generated by:
https://github.com/jondurbin/airoboros/blob/main/airoboros/instructors/prompts/misconception.txt
I removed all of the overlaps I could find via similarity search and re-created the model, and the score is back to a "normal" range for this model.
Perfect, merged! Thank you for your efforts :)