5B merge?
#2
by
EloyOn
- opened
Have you considered merging this model up to 5B to see if it improves significantly?
That size might work well having into account smarphones RAM and CPU limitations.
Something similar to this: https://huggingface.co/dillfrescott/sonya-medium
I haven’t much experience with creating merges to be honest. I’ll explore that when I have some free time.
If you have experience with creating merges, please feel free to do so with Layla models!
Sadly I don't T_T If I had a good computer I would spend all the time trying that probably xDDD
Seems they use this mergekit: https://github.com/arcee-ai/mergekit