Model: hkust-nlp/dart-math-llama3-70b-uniform
Author: hkust-nlp
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, mathematics, en, dataset:hkust-nlp/dart-math-uniform, arxiv:2407.13690, arxiv:2403.04706, arxiv:2403.02884, base_model:meta-llama/Meta-Llama-3-70B, base_model:finetune:meta-llama/Meta-Llama-3-70B, license:llama3, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: meta-llama/Meta-Llama-3-70B
Card metadata: language: en
license: llama3
library_name: transformers
tags: mathematics
datasets: hkust-nlp/dart-math-uniform
metrics: accuracy
pipeline_tag: text-generation
base_model: meta-llama/Meta-Llama-3-70B
model-index: name: dart-math-llama3-70b-uniform
results: task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: hendrycks/competition_math
name: MATH
split: test
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 54.9
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: openai/gsm8k
name: GSM8K
config: main
split: test
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 90.4
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: college-math
name: CollegeMath
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 38.5
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: deepmind-mathematics
name: DeepMind-Mathematics
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 64.1
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: Hothan/OlympiadBench
name: OlympiadBench-OE_TO_maths_en_COMP
config: OE_TO_maths_en_COMP
split: train
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 19.1
verified: no, task: type: text-generation
name: Mathematical Problem-Solving
dataset: type: TIGER-Lab/TheoremQA
name: TheoremQA
split: test
metrics: type: accuracy
name: Pass@1 (0-shot CoT)
value: 27.4
verified: no
Likes: 1 | All-time downloads: 363
Created: 2024-06-07 13:03:01