TheTsar1209's picture
Update README.md
081f6b0 verified
metadata
base_model: unsloth/Qwen2.5-14B-Instruct-bnb-4bit
language:
  - en
license: apache-2.0
tags:
  - text-generation-inference
  - transformers
  - unsloth
  - qwen2
  - trl

A Fishy Model

This model was trained on with SFT on the ChatML format with 8k context.

The main difference from v0.1 and v0.2 was that v0.1 was trained on responses only while v0.2 was not.

Uploaded model

  • Developed by: TheTsar1209
  • License: apache-2.0
  • Finetuned from model : unsloth/Qwen2.5-14B-Instruct-bnb-4bit

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.