Model: hkust-nlp/dart-math-mistral-7b-prop2diff
Author: hkust-nlp
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, mistral, text-generation, mathematics, en, dataset:hkust-nlp/dart-math-hard, arxiv:2407.13690, arxiv:2403.04706, arxiv:2403.02884, base_model:mistralai/Mistral-7B-v0.1, base_model:finetune:mistralai/Mistral-7B-v0.1, license:apache-2.0, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: mistralai/Mistral-7B-v0.1
Card metadata: language: en
license: apache-2.0
library_name: transformers
tags: mathematics
datasets: hkust-nlp/dart-math-hard
metrics: accuracy
pipeline_tag: text-generation
base_model: mistralai/Mistral-7B-v0.1
model-index: name: dart-math-mistral-7b-prop2diff
results: task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: hendrycks/competition_math
name: MATH
split: test
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 45.5
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: openai/gsm8k
name: GSM8K
config: main
split: test
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 81.1
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: college-math
name: CollegeMath
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 29.4
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: deepmind-mathematics
name: DeepMind-Mathematics
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 45.1
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: Hothan/OlympiadBench
name: OlympiadBench-OE_TO_maths_en_COMP
config: OE_TO_maths_en_COMP
split: train
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 14.7
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: TIGER-Lab/TheoremQA
name: TheoremQA
split: test
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 17
verified: no
Likes: 1 | All-time downloads: 1105
Created: 2024-06-05 14:13:01