Minotaur-13B with 10k+ context using Landmark Attention.
Model generated using Landmark-Attention-QLoRA
https://github.com/eugenepentland/landmark-attention-qlora
A merge of the following models:
https://huggingface.co/openaccess-ai-collective/minotaur-13b
https://huggingface.co/eugenepentland/Minotaur-13b-Landmark-QLoRA
Can be loaded in using oobooga, make sure to have the --trust-remote-code option on for it to function.
- Downloads last month
- 4