Model: hkust-nlp/dart-math-dsmath-7b-prop2diff
Author: hkust-nlp
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, mathematics, en, dataset:hkust-nlp/dart-math-hard, arxiv:2407.13690, arxiv:2403.04706, arxiv:2403.02884, base_model:deepseek-ai/deepseek-math-7b-base, base_model:finetune:deepseek-ai/deepseek-math-7b-base, license:other, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: deepseek-ai/deepseek-math-7b-base
Card metadata: language: en
license: other
license_name: deepseek
license_link: https://github.com/deepseek-ai/DeepSeek-Math/blob/main/LICENSE-MODEL
library_name: transformers
tags: mathematics
datasets: hkust-nlp/dart-math-hard
metrics: accuracy
pipeline_tag: text-generation
base_model: deepseek-ai/deepseek-math-7b-base
model-index: name: dart-math-dsmath-7b-prop2diff
results: task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: hendrycks/competition_math
name: MATH
split: test
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 53.6
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: openai/gsm8k
name: GSM8K
config: main
split: test
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 86.8
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: college-math
name: CollegeMath
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 40.7
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: deepmind-mathematics
name: DeepMind-Mathematics
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 61.6
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: Hothan/OlympiadBench
name: OlympiadBench-OE_TO_maths_en_COMP
config: OE_TO_maths_en_COMP
split: train
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 21.7
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: TIGER-Lab/TheoremQA
name: TheoremQA
split: test
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 32.2
verified: no
Likes: 3 | All-time downloads: 1527
Created: 2024-06-05 17:30:14