README.md

metadata

license: other
license_name: hsul
license_link: https://huggingface.co/OEvortex/vortex-3b/raw/main/LICENSE.md
language:
  - en
pipeline_tag: text-generation
tags:
  - 3B

HelpingAI-3B

Introduction

HelpingAI-3B is a state-of-the-art AI model designed to assist with day-to-day tasks. It's trained on a diverse range of datasets, making it versatile and adaptable to various applications.

Model Overview

HelpingAI-3B is the latest model in the HelpingAI series. It's built on advanced machine learning algorithms and trained on a wide variety of data sources. This ensures that the model is capable of understanding and generating responses in a wide range of contexts.

Performance Comparison

The performance of HelpingAI-3B is compared with other relevant models on various metrics in the table below:

Model	Average	ARC	HellaSwag	MMLU	TruthfulQA	Winogrande	GSM8K
rocket-3B	55.77	50.6	76.69	47.1	55.82	67.96	36.47
HelpingAI-3B	55.59	50.6	76.64	46.82	55.62	67.8	36.09
stableLM-zephyr-3b	53.43	46.08	74.16	46.17	46.49	65.51	42.15
mmd-3b	53.22	44.8	70.41	50.9	43.2	66.22	43.82
MiniGPT-3B-Bacchus	52.55	43.52	70.45	50.49	43.52	66.85	40.49
MiniGPT-3B-Hercules-v2.0	52.52	43.26	71.11	51.82	40.37	66.46	42.08
MiniGPT-3B-OpenHermes-2.5-v2	51.91	47.44	72	53.06	42.28	65.43	31.24
MiniChat-2-3B	51.49	44.88	67.69	47.59	49.64	66.46	32.68
smol-3b	50.27	46.33	68.23	46.33	50.73	65.35	24.64
MiniChat-1.5-3B	50.23	46.5	68.28	46.67	50.71	65.04	24.18
3BigReasonCinder	48.16	41.72	65.16	44.79	44.76	64.96	27.6
MintMerlin-3B	47.63	44.37	66.56	43.21	47.07	64.4	20.17