Artificial Analysis Intelligence Index: Score

#5
by RichardDeetlefs - opened

It seems as though AA lowered the score of all models in general; maybe they rebalanced the leaderboard now that so many models have become a lot more intelligent. The whole chart in the README.md should probably be updated.

inclusionAI org

For everyone's information, the AA intelligence index were updated to 4.2 then to 4.3 in the past week without prior notice. It is coincidental that the updates of the index were overlapping with our launch dates.
Our released score were tested against v4.1 and it was the latest and greatest at our release date. This is not the first time the index were updated and it'll not be the last time either. We are evaluating the options to properly handle updates like this.

Thanks for the heads-up. We'll update our documentation on AA scores as soon as possible. AA has released two consecutive versions in recent days—25 is the score from the latest version (AA V4.3), while 42 is from the version before last.

Sign up or log in to comment