MyAwesomeModel

Selected checkpoint: checkpoints/step_1000 (highest eval_accuracy = 0.828). Overall weighted evaluation score: 0.710.

Evaluation Results

All scores below are reported to three decimal places.

Category	Benchmark	Score
Core Reasoning Tasks	Math Reasoning	0.550
Core Reasoning Tasks	Logical Reasoning	0.819
Core Reasoning Tasks	Common Sense	0.736
Language Understanding	Reading Comprehension	0.700
Language Understanding	Question Answering	0.607
Language Understanding	Text Classification	0.828
Language Understanding	Sentiment Analysis	0.792
Generation Tasks	Code Generation	0.650
Generation Tasks	Creative Writing	0.610
Generation Tasks	Dialogue Generation	0.644
Generation Tasks	Summarization	0.767
Specialized Capabilities	Translation	0.804
Specialized Capabilities	Knowledge Retrieval	0.676
Specialized Capabilities	Instruction Following	0.758
Specialized Capabilities	Safety Evaluation	0.739

Usage

from transformers import AutoModelForSequenceClassification
model = AutoModelForSequenceClassification.from_pretrained("asfafaaf3434/MyAwesomeModel")