Model: rubra-ai/Phi-3-mini-128k-instruct
Author: rubra-ai
Pipeline: text-generation
Library: transformers
Tags: transformers, tensorboard, safetensors, phi3, text-generation, function-calling, tool-calling, agentic, rubra, conversational, custom_code, en, doi:10.57967/hf/2682, license:mit, model-index, text-generation-inference, endpoints_compatible, region:us
Card metadata: license: mit
library_name: transformers
pipeline_tag: text-generation
model-index: name: Rubra-Phi-3-mini-128k-instruct
results: task: type: text-generation
dataset: type: MMLU
name: MMLU
metrics: type: 5-shot
value: 67.87
verified: no, task: type: text-generation
dataset: type: GPQA
name: GPQA
metrics: type: 0-shot
value: 29.69
verified: no, task: type: text-generation
dataset: type: GSM-8K
name: GSM-8K
metrics: type: 8-shot, CoT
value: 79.45
verified: no, task: type: text-generation
dataset: type: MATH
name: MATH
metrics: type: 4-shot, CoT
value: 30.8
verified: no, task: type: text-generation
dataset: type: MT-bench
name: MT-bench
metrics: type: GPT-4 as Judge
value: 8.21
verified: no
tags: function-calling, tool-calling, agentic, rubra, conversational
language: en
Likes: 10 | All-time downloads: 3398
Created: 2024-06-15 07:06:44