Hugging Face's logo

ethzanalytics
/
gpt-j-8bit-KILT_WoW_10k_steps

Text Generation
Transformers
PyTorch
gptj
8bit
8-bit precision
quantization
compression
chatbot
dialogue
conversation
Model card Files Community
gpt-j-8bit-KILT_WoW_10k_steps / README.md
pszemraj's picture
pszemraj
Update README.md
12e7206
preview code
|
raw
history blame
No virus
1.13 kB
metadata
tags:
  - text-generation
  - 8bit
  - 8-bit
  - quantization
  - compression
inference: false
license: apache-2.0

ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps

Open In Colab

This is a version of hivemind/gpt-j-6B-8bit fine-tuned on the Wizard of Wikipedia dataset for 10k steps (just under an epoch) on an A100. it can be used as a chatbot. It is designed to be used with ai-msgbot to take advantage of the prompt engineering.

NOTE: this needs to be loaded via the special patching technique outlined in the hivemind model card (as with all 8bit models)

Training

For details, please see this wandb report for both the daily-dialogues version and the WoW version.

TODO: rest of README