Model: prince-canuma/Damysus-2.7B-Chat
Author: prince-canuma
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, phi, text-generation, nlp, phi-2, instruct, conversational, custom_code, en, dataset:Open-Orca/SlimOrca, dataset:prince-canuma/TinyOrca, base_model:microsoft/phi-2, base_model:finetune:microsoft/phi-2, license:mit, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: microsoft/phi-2
Card metadata: language: en
license: mit
library_name: transformers
tags: nlp, phi, phi-2, instruct
base_model: microsoft/phi-2
datasets: Open-Orca/SlimOrca, prince-canuma/TinyOrca
model-index: name: Damysus-2.7B-Chat
results: task: type: text-generation
metrics: name: Average
type: Average
value: 60.49
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard, task: type: text-generation
dataset: name: ARC (25-shot)
type: ai2_arc
metrics: name: Accuracy Norm
type: acc_norm
value: 59.81
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard, task: type: text-generation
dataset: name: Hellaswag (10-shot)
type: Hellaswag
metrics: name: Accuracy Norm
type: acc
value: 74.52
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard, task: type: text-generation
dataset: name: MMLU (5-shot)
type: MMLU
metrics: name: Accuracy
type: acc
value: 56.33
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard, task: type: text-generation
dataset: name: Truthful QA
type: Truthful_QA
metrics: name: Multi-true
type: mc2
value: 46.74
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard, task: type: text-generation
dataset: name: Winogrande (5-shot)
type: Winogrande
metrics: name: Accuracy
type: acc
value: 75.06
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard, task: type: text-generation
dataset: name: GSM8K (5-shot)
type: GSM8K
metrics: name: Accuracy
type: acc
value: 50.64
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
Likes: 4 | All-time downloads: 12681
Created: 2024-02-11 14:43:52