linlinlin/zephy_SFT_Hermes

Model Card for Model ID

A SFT version on Mistral-7B-v0.1 using dataset teknium/OpenHermes-2.5

Model Details

Model Description

• Developed by: Kunlin Tan
• Model type: Transformers
• License: MIT
• Finetuned from model: mistralai/Mistral-7B-v0.1

Uses

from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM

config = PeftConfig.from_pretrained("linlinlin/zephy_SFT_Hermes")
model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-v0.1")
model = PeftModel.from_pretrained(model, "linlinlin/zephy_SFT_Hermes")

Training Details

Training Data

teknium/OpenHermes-2.5

Technical Specifications

Hardware

RTX-4090

Software

Ubuntu 22.04

Framework versions

• PEFT 0.9.0