What is the base model that sea-lion-7b was built on ?
#12
by
YaoLiu61
- opened
Hi, thanks to your great work. I have a question:
What is the base model that sea-lion-7b was built on ? I didnt see it in the model card.
Dear @YaoLiu61 ,
Thank you for your interest in SEA-LION.
The SEA-LION-7B and SEA-LION-3B are not continued pre-trained from any base model, they are pre-trained from scratch using a modified MPT architecture from MosaicML.