FMLM (OWT)

For more information and implementation details, visit our github repository: FLM.

Model Details

The model has a context length of 1024, distilled from 1M steps trained FLM checkpoint trained on the OpenWebText (OWT) dataset.

For more details, please see our paper:

Citation

Please cite our work using the bibtex below:

BibTeX:

@article{lee2026flow,
    title={Flow Map Language Models: One-step Language Modeling via Continuous Denoising},
    author={Chanhyuk Lee and Jaehoon Yoo and Manan Agarwal
            and Sheel Shah and Jerry Huang
            and Aditi Raghunathan and Seunghoon Hong
            and Nicholas M. Boffi and Jinwoo Kim},
    journal={arXiv preprint arXiv:2602.16813},
    year={2026},
}