MedAgentsBench: Benchmarking Thinking Models and Agent Frameworks for Complex Medical Reasoning
Paper
•
2503.07459
•
Published
•
14
•
3
vansin
vansin
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 15 hours ago
Feature-Level Insights into Artificial Text Detection with Sparse
Autoencoders
posted
an
update
about 20 hours ago
🔥MedAgentBench Amazing Work🚀
Just explored #MedAgentBench from @Yale researchers and it's mind-blowing! They've created a cutting-edge benchmark that finally exposes the true capabilities of LLMs in complex medical reasoning.
⚡ Key discoveries:
DeepSeek R1 & OpenAI O3 dominate clinical reasoning tasks
Agent-based frameworks deliver exceptional performance-cost balance
Open-source alternatives are closing the gap at fraction of the cost
This work shatters previous benchmarks that failed to challenge today's advanced models.
The future of medical AI is here: https://github.com/gersteinlab/medagents-benchmark
#MedicalAI #MachineLearning #AIinHealthcare 🔥
commented on
a paper
1 day ago
MedAgentsBench: Benchmarking Thinking Models and Agent Frameworks for
Complex Medical Reasoning
Organizations
vansin's activity
commented
7
papers
1 day ago
ProBench: Judging Multimodal Foundation Models on Open-ended Multi-domain Expert Tasks
Paper
•
2503.06885
•
Published
•
3
•
3
MinorBench: A hand-built benchmark for content-based risks for children
Paper
•
2503.10242
•
Published
•
4
•
3
MedAgentsBench: Benchmarking Thinking Models and Agent Frameworks for Complex Medical Reasoning
Paper
•
2503.07459
•
Published
•
14
•
3
FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementation
Paper
•
2503.06680
•
Published
•
17
•
7
VisualPRM: An Effective Process Reward Model for Multimodal Reasoning
Paper
•
2503.10291
•
Published
•
29
•
3
Charting and Navigating Hugging Face's Model Atlas
Paper
•
2503.10633
•
Published
•
52
•
5
commented
3
papers
2 days ago
Charting and Navigating Hugging Face's Model Atlas
Paper
•
2503.10633
•
Published
•
52
•
5
Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
Paper
•
2503.09573
•
Published
•
50
•
3
TPDiff: Temporal Pyramid Video Diffusion Model
Paper
•
2503.09566
•
Published
•
39
•
3
commented
2
papers
4 days ago
VisualSimpleQA: A Benchmark for Decoupled Evaluation of Large Vision-Language Models in Fact-Seeking Question Answering
Paper
•
2503.06492
•
Published
•
9
•
4
VisualSimpleQA: A Benchmark for Decoupled Evaluation of Large Vision-Language Models in Fact-Seeking Question Answering
Paper
•
2503.06492
•
Published
•
9
•
4
commented
5
papers
11 days ago
Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models
Paper
•
2503.01763
•
Published
•
4
•
2
FLAME: A Federated Learning Benchmark for Robotic Manipulation
Paper
•
2503.01729
•
Published
•
4
•
2
Benchmarking Large Language Models for Multi-Language Software Vulnerability Detection
Paper
•
2503.01449
•
Published
•
4
•
2
CognitiveDrone: A VLA Model and Evaluation Benchmark for Real-Time Cognitive Task Solving and Reasoning in UAVs
Paper
•
2503.01378
•
Published
•
3
•
2
SwiLTra-Bench: The Swiss Legal Translation Benchmark
Paper
•
2503.01372
•
Published
•
3
•
2
commented
a
paper
23 days ago
Application of InternLM3 to Join the leaderboard
#5 opened 23 days ago
by
vansin
Application of InternLM3 to Join the leaderboard
1
#9 opened 23 days ago
by
vansin