jablonkagroup/ChemBench-Results-dev huggingface dataset:
ChemBench leaderboard entry
Model: moonshotai/kimi-k2-instruct-0905
Description: Kimi K2 0905 is Moonshot AI's improved version of the Kimi K2 model, featuring enhanced coding capabilities with superior frontend development and tool calling performance.
Published: YYYY-MM-DD
Number of parameters: 1000
Training tokens: 15500000000000
Architecture: transformer
Open weights: yes
Open dataset: no
Mixture of experts: yes
Alignment method: RLVR
RLHF: no
Domain-specific pretraining: no
Domain-specific finetuning: no
Tool use: no
Reasoning model: yes
Scores:
Overall: 0.5965541995692749
Analytical Chemistry: 0.5789473684210527
Chemical Preference: 0.518
General Chemistry: 0.8322147651006712
Inorganic Chemistry: 0.7717391304347826
Materials Science: 0.75
Organic Chemistry: 0.8135198135198135
Physical Chemistry: 0.7636363636363637
Technical Chemistry: 0.775
Toxicity and Safety: 0.4325925925925926