alpasta30b / README.md
askmyteapot's picture
Update README.md
1cdb799

Dont be upsetti, here, have some spaghetti! Att: A'eala <3

Information

GPT4-X-Alpasta-30b working with Oobabooga's Text Generation Webui and KoboldAI.

This is an attempt at improving Open Assistant's performance as an instruct while retaining its excellent prose. The merge consists of Chansung's GPT4-Alpaca Lora and Open Assistant's native fine-tune.

Benchmarks

FP16

Wikitext2: 4.6077961921691895

Ptb-New: 9.41549301147461

C4-New: 6.98392915725708

Benchmarks brought to you by A'eala

Benchmarks

GPTQ 4Bit Act-order True-Sequential

Wikitext2: 4.981262683868408

Ptb-New: 9.737570762634277

C4-New: 7.332120418548584

Benchmarks brought to you by Askmyteapot