Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior

This repository contains a model from the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior.

The model is a SmolLM3-based causal language model designed for text generation and is compatible with the transformers library.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for verify-ppt/ppt_smollm3_500m_v2