phanerozoic's picture
Update README.md
f1aa2cd
|
raw
history blame contribute delete
No virus
555 Bytes
---
license: other
language:
- en
tags:
- art
---
llama2-piratelora-13b
This repo contains a Low-Rank Adapter (LoRA) for llama 2 13b (16 float) fit on a simple dataset comprised of thousands of pirate phrases, conversation pieces, and obscura. The purpose behind the generation of this lora was to determine whether enforcement of dialect and diction was possible throug the LoRa fine tuning method. Results were less than perfect, but the LoRa does seem to push the model to stick to maritime and nautical topics when spontaneously prompted to generate.