|
--- |
|
tags: |
|
- text-generation |
|
- 8bit |
|
- 8-bit |
|
- quantization |
|
- compression |
|
inference: False |
|
license: apache-2.0 |
|
--- |
|
|
|
# ethzanalytics/gpt-j-8bit-daily_dialogues_1E |
|
|
|
This is a version of `hivemind/gpt-j-6B-8bit` fine-tuned on the daily-dialogues dataset for an epoch. it can be used as a chatbot. |
|
|
|
_NOTE: this needs to be loaded via the special patching technique outlined in the hivemind model card (as with all 8bit models)_ |
|
|
|
|
|
TODO: rest of README |
|
|
|
|
|
--- |
|
|
|
|
|
[original demo link](https://colab.research.google.com/gist/pszemraj/76c0a80c9eacfb2c31e21c4cceb344a0/ai-msgbot-gpt-j-6b-8bit-chatbot-demo.ipynb) |
|
|
|
|
