GenAI-llama-2-13b / README.md
ddobokki's picture
Adding Evaluation Results (#2)
99440b6
metadata
language:
  - en
tags:
  - llama-2
  - instruct
  - instruction
pipeline_tag: text-generation

GenAI-llama-2-13b

Model Details

Used Datasets

  • Orca-style dataset
  • Platypus

Prompt Template

### User:
{User}

### Assistant:
{Assistant}

Intruduce 42MARU

  • At 42Maru we study QA (Question Answering) and are developing advanced search paradigms that help users spend less time searching by understanding natural language and intention thanks to AI and Deep Learning.
  • About Us
  • Contact Us

Contribute

License

LICENSE.txt

USE_POLICY

USE_POLICY.md

Responsible Use Guide

Responsible-Use-Guide.pdf

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 56.03
ARC (25-shot) 63.14
HellaSwag (10-shot) 83.64
MMLU (5-shot) 59.91
TruthfulQA (0-shot) 56.21
Winogrande (5-shot) 76.72
GSM8K (5-shot) 9.4
DROP (3-shot) 43.23