joinse

ommuni6661

AI & ML interests

None yet

Recent Activity

liked a Space about 12 hours ago

openfree/Korean-Exam-Leaderboard

reacted to openfree's post with 👍 about 12 hours ago

Korean Exam Leaderboard: LLMs vs Civil Service and Professional Qualification Exams 📝 https://huggingface.co/spaces/openfree/Korean-Exam-Leaderboard ## 📊 What is this leaderboard? This leaderboard evaluates the performance of various AI models on 22 Korean civil service and professional qualification exams. All scores are converted to a 100-point scale to show how well different LLMs can solve actual Korean civil service and professional qualification tests! ## 🏆 Current Top Performers - **OpenAI/GPT-o1**: Bar Exam 52.5 points 🥇 - **OpenAI/GPT-4.5**: Bar Exam 49.33 points 🥈 - **OpenAI/GPT-4o**: Bar Exam 49.11 points 🥉 - **deepseek-ai/DeepSeek-R1**: Bar Exam 47.33 points ## 📋 Exams Being Evaluated The leaderboard includes various Korean civil service and professional qualification exams: - Korean Bar Exam - Senior Civil Service Grade 5 - Judicial Service Grade 5 - National Assembly Grade 5 - Judicial Scrivener - Police Executive Candidate - And more exams! ## 🤖 Models Being Evaluated We are testing a variety of models: - OpenAI: GPT-o1, GPT-o3-mini, GPT-4.5, GPT-4o - Anthropic: Claude 3.7 Sonnet - Google: Gemini 2.0 Flash/PRO/Flash Thinking - Meta: Llama 3.3 70B Instruct, Llama 3.2 90B Vision - DeepSeek: DeepSeek-R1 - Qwen: QwQ-32B, Qwen2.5 Coder - Mistral: Mistral-Small-3.1-24B - NVIDIA models: NVIDIA Nemotron variant models - And many more! ## 🔍 Why This Matters Korean civil service exams are known for their high difficulty and comprehensive knowledge assessment. These exams test deep knowledge across legal, administrative, and public service domains. Success in these exams demonstrates not just language understanding but also domain expertise and reasoning ability. ## 🧪 Evaluation Methodology 🔜 Future Plans We are continuously expanding our test coverage across all 22 exam categories. We will keep updating the scores marked "TBD" so please stay tuned!

reacted to openfree's post with 🤝 about 12 hours ago

View all activity

Organizations

None yet

ommuni6661's activity

liked a Space about 12 hours ago

Korean Exam Leaderboard

🥇

MIPA(Korea Mobile Infra Promotion Associaton)

reacted to openfree's post with 👍🤝😔🤯🧠➕😎🤗❤️👀🚀🔥 about 12 hours ago

Post

1248

Korean Exam Leaderboard: LLMs vs Civil Service and Professional Qualification Exams 📝

openfree/Korean-Exam-Leaderboard

## 📊 What is this leaderboard?
This leaderboard evaluates the performance of various AI models on 22 Korean civil service and professional qualification exams. All scores are converted to a 100-point scale to show how well different LLMs can solve actual Korean civil service and professional qualification tests!

## 🏆 Current Top Performers
- **OpenAI/GPT-o1**: Bar Exam 52.5 points 🥇
- **OpenAI/GPT-4.5**: Bar Exam 49.33 points 🥈
- **OpenAI/GPT-4o**: Bar Exam 49.11 points 🥉
- **deepseek-ai/DeepSeek-R1**: Bar Exam 47.33 points

## 📋 Exams Being Evaluated
The leaderboard includes various Korean civil service and professional qualification exams:
- Korean Bar Exam
- Senior Civil Service Grade 5
- Judicial Service Grade 5
- National Assembly Grade 5
- Judicial Scrivener
- Police Executive Candidate
- And more exams!

## 🤖 Models Being Evaluated
We are testing a variety of models:
- OpenAI: GPT-o1, GPT-o3-mini, GPT-4.5, GPT-4o
- Anthropic: Claude 3.7 Sonnet
- Google: Gemini 2.0 Flash/PRO/Flash Thinking
- Meta: Llama 3.3 70B Instruct, Llama 3.2 90B Vision
- DeepSeek: DeepSeek-R1
- Qwen: QwQ-32B, Qwen2.5 Coder
- Mistral: Mistral-Small-3.1-24B
- NVIDIA models: NVIDIA Nemotron variant models
- And many more!

## 🔍 Why This Matters
Korean civil service exams are known for their high difficulty and comprehensive knowledge assessment. These exams test deep knowledge across legal, administrative, and public service domains. Success in these exams demonstrates not just language understanding but also domain expertise and reasoning ability.

## 🧪 Evaluation Methodology

🔜 Future Plans
We are continuously expanding our test coverage across all 22 exam categories. We will keep updating the scores marked "TBD" so please stay tuned!