metadata

library_name: peft
license: llama2
datasets:
  - ehartford/dolphin
tags:
  - llama-2
inference: false
pipeline_tag: text-generation

llama-2-70b-dolphin 🦙🐬

This instruction model was built via parameter-efficient QLoRA finetuning of llama-2-70b on the first 25k rows of ehartford/dolphin (an open-source implementation of Microsoft's Orca). Finetuning was executed on a single H100 (80 GB PCIe) for roughly 17 hours on the Lambda Labs platform.

Framework versions

PEFT 0.5.0.dev0