The official base model weights for "Efficient Continual Pre-training by Mitigating the Stability Gap".
The model has been continually pretrained on a high-quality medical sub-corpus from the RefinedWeb dataset.
- Downloads last month
- 1
The official base model weights for "Efficient Continual Pre-training by Mitigating the Stability Gap".
The model has been continually pretrained on a high-quality medical sub-corpus from the RefinedWeb dataset.