metadata
language:
- en
datasets:
- teknium/OpenHermes-2.5
license: other
license_name: llama3
base_model: unsloth/llama-3-8b-Instruct-bnb-4bit
tags:
- unsloth
- facebook
- meta
- pytorch
- llama
- llama-3
- trl
QLoRA Finetune Llama 3 Instruct 8B + OpenHermes 2.5
This model is based on Llama-3-8b, and is governed by META LLAMA 3 COMMUNITY LICENSE AGREEMENT
Llama 3 Instruct 8B 4-bit from unsloth, finetuned with the OpenHermes 2.5 dataset on my home PC on one 24GB 4090.
Special care was taken to preserve and reinforce proper eos token structure.