FLM (OpenWebText)

For more information and implementation details, visit our github repository: FLM.

Model Details

The model has a context length of 1024, trained for 1M steps on the OpenWebText dataset.

For more details, please see our paper:

Citation

Please cite our work using the bibtex below:

BibTeX:

@article{lee2026flow,
    title={Flow Map Language Models: One-step Language Modeling via Continuous Denoising},
    author={Chanhyuk Lee and Jaehoon Yoo and Manan Agarwal
            and Sheel Shah and Jerry Huang
            and Aditi Raghunathan and Seunghoon Hong
            and Nicholas M. Boffi and Jinwoo Kim},
    journal={arXiv preprint arXiv:2602.16813},
    year={2026},
}