tigerbot-7b-base / README.md
leaderboard-pr-bot's picture
Adding Evaluation Results
ef57e8c
|
raw
history blame
2.9 kB
metadata
license: apache-2.0

TigerBot

A cutting-edge foundation for your very own LLM.

💻Github • 🌐 TigerBot • 🤗 Hugging Face

快速开始

  • 方法1,通过transformers使用

    • 下载 TigerBot Repo

      git clone https://github.com/TigerResearch/TigerBot.git
      
    • 启动infer代码

      python infer.py --model_path TigerResearch/tigerbot-7b-base
      
  • 方法2:

    • 下载 TigerBot Repo

      git clone https://github.com/TigerResearch/TigerBot.git
      
    • 安装git lfs: git lfs install

    • 通过huggingface或modelscope平台下载权重

      git clone https://huggingface.co/TigerResearch/tigerbot-7b-base
      git clone https://www.modelscope.cn/TigerResearch/tigerbot-7b-base-v3.git
      
    • 启动infer代码

      python infer.py --model_path tigerbot-7b-base(-v3) --model_type base --max_generate_length 64
      

Quick Start

  • Method 1, use through transformers

    • Clone TigerBot Repo

      git clone https://github.com/TigerResearch/TigerBot.git
      
    • Run infer script

      python infer.py --model_path TigerResearch/tigerbot-7b-base
      
  • Method 2:

    • Clone TigerBot Repo

      git clone https://github.com/TigerResearch/TigerBot.git
      
    • install git lfs: git lfs install

    • Download weights from huggingface or modelscope

      git clone https://huggingface.co/TigerResearch/tigerbot-7b-base
      git clone https://www.modelscope.cn/TigerResearch/tigerbot-7b-base-v3.git
      
    • Run infer script

      python infer.py --model_path tigerbot-7b-base(-v3) --model_type base --max_generate_length 64
      

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 41.99
ARC (25-shot) 47.7
HellaSwag (10-shot) 72.08
MMLU (5-shot) 45.11
TruthfulQA (0-shot) 42.27
Winogrande (5-shot) 69.61
GSM8K (5-shot) 10.84
DROP (3-shot) 6.3