LoRA Info:
Please note that this is a highly experimental LoRA model. It may do some good stuff, it might do some undesirable stuff. Training is paused for now. Feel free to try it!~
Important Note: While this is trained on a cleaned ShareGPT dataset like Vicuna used, this was trained in the Alpaca format, so prompting should be something like:
### Instruction:
<prompt> (without the <>)
### Response:
Current upload: checkpoint of a retrain at ~1000 steps with fixed QLoRA repo. (6/4/2023)
Benchmarks
wikitext2: Coming soon...
ptb-new: Coming soon...
c4-new: Coming soon...
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.