metadata
datasets:
- databricks/databricks-dolly-15k
- nomic-ai/gpt4all-j-prompt-generations
- open_assist_plus_safety
- oasst
- etc.
language:
- en
- Model is finetuned from pygmalion-6B using LoRA and 8-bit quantization on an RTX 2080Ti
- LoRA parameters: r=8, alpha=16, dropout=0.05, bias=None
- All prompts are formatted to conversations pairs of [USER] and [Yaya]. For example:
[User]: Compose a long Gulf War story set in Istanbul, where a content chair encounters Elizabeth Barrett Browning, inspired by the works of Henrik Ibsen. [Yaya]: As an old and content chair sat in the corner of a bustling coffee house in Istanbul, he witnessed the city's frenzied energy. It was the early 1990s, and the Gulf War had just begun.
There was great political strife in the air, and tensions were high. People rushed about, frantically discussing the war and its potential impact on their lives. [...]