Upvote to evaluate deepseek-coder-v2

#793
by g1y5x3 - opened

From personal experience and some community feedback from reddit, deepseek-coder-v2 is having very impressive performance in various math and coding tasks. So I thought it would be nice to know how well it does overall. If there's enough community interest, the devs at HF will consider run the evals manually even their code are not in stable transformer stable version yet.

Deepseek-coder is for sure one of the coding models I hear the most about (together with starcoder). And having it's code checked would be good because people are trusting and running it.

clefourrier changed discussion title from Are there enough interest to benchmark deepseek-coder-v2 to Upvote to evaluate deepseek-coder-v2
Open LLM Leaderboard org

Hi! Please upvote the first post to manifest your interest in the eval of this model!

Could you evaluate DeepSeek V2.5, or whatever the current DeepSeek general purpose is at the time?

clefourrier changed discussion status to closed

Sign up or log in to comment