Model: hkust-nlp/dart-math-llama3-70b-prop2diff
Author: hkust-nlp
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, mathematics, en, dataset:hkust-nlp/dart-math-hard, arxiv:2407.13690, arxiv:2403.04706, arxiv:2403.02884, base_model:meta-llama/Meta-Llama-3-70B, base_model:finetune:meta-llama/Meta-Llama-3-70B, license:llama3, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: meta-llama/Meta-Llama-3-70B
Card metadata: language: en
license: llama3
library_name: transformers
tags: mathematics
datasets: hkust-nlp/dart-math-hard
metrics: accuracy
pipeline_tag: text-generation
base_model: meta-llama/Meta-Llama-3-70B
model-index: name: dart-math-llama3-70b-prop2diff
results: task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: hendrycks/competition_math
name: MATH
split: test
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 56.1
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: openai/gsm8k
name: GSM8K
config: main
split: test
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 89.6
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: college-math
name: CollegeMath
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 37.9
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: deepmind-mathematics
name: DeepMind-Mathematics
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 64.1
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: Hothan/OlympiadBench
name: OlympiadBench-OE_TO_maths_en_COMP
config: OE_TO_maths_en_COMP
split: train
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 20
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: TIGER-Lab/TheoremQA
name: TheoremQA
split: test
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 28.2
verified: no
Likes: 0 | All-time downloads: 220
Created: 2024-06-05 20:54:23