How to Finetune striped hyena for custom dataset in colabT4
#6
by
Jaykumaran17
- opened
Hi Team,
I would like to know the finetuning code details of Striped Hyena Nous 7b.Unlike Transformers models it extends some architectural changes,so should the code for finetuning and training on custom dataset differs.Can i follow same approach to finetune like Zephyr7b?.Hoping for a reference code or additional clarity on this.Also i face some errors while loading model for inference
Jaykumaran17
changed discussion title from
How to Finetune striped hyena for custom dataset
to How to Finetune striped hyena for custom dataset in colabT4
Take a look at this repo for finetuning code: https://github.com/NousResearch/StripedHyenaTrainer