| --- |
| license: apache-2.0 |
| tags: |
| - materials |
| - qwen3 |
| - diffusion |
| - crystal-structure-prediction |
| - crystal-generation |
| --- |
| # Atomistic Language Models |
|
|
| A single Qwen3-8B backbone that understands, generates, and edits crystals by reading |
| atoms as **soft tokens** from a machine-learning interatomic potential and steering a |
| MatterGen diffusion decoder with classifier-free guidance. One repo, one subdir per model: |
|
|
| | subdir | model | what | |
| |---|---|---| |
| | `stage1-projector/` | structure-to-language projector | OrbV3 → Qwen3 soft tokens (~70 MB) | |
| | `alm-core/` | **ALM Core** | understanding: Qwen3-8B + LoRA (r128) + projector | |
| | `alm-gen/` | **ALM Gen** | de-novo generation: consumer-only bridge (r8) over `mattergen_base` | |
| | `alm-edit/` | **ALM Edit** | CSP + editing: producer-consumer bridge + full-FT Qwen3-8B (`llm_full_ft/`) + `csp_backbone/` decoder | |
|
|
| Headlines (paper, https://arxiv.org/abs/2606.21395). **ALM Edit**: CSP MR@20 **83.2%** / RMSE@1 **0.021 Å** |
| (MP-20, SoTA), and SoTA across the **ALM Bench** editing tasks. **ALM Gen**: de-novo SUN |
| **7.80%** on the MP-20 hull (above the g=0 MatterGen base) and metastable **MSUN 35.2%** on |
| LeMat-GenBench. See each subdir's card for full tables. |
|
|
| Download into `./checkpoints/` with `hf download LearningMatter/AtomisticLanguageModels --local-dir ./checkpoints`. |
| The **ALM Bench** dataset lives in `LearningMatter/ALM-Bench`. `mattergen_base` (ALM Gen's backbone) is |
| fetched from `microsoft/mattergen`; `alm-edit/csp_backbone/` (the CSP decoder) ships here. |
|
|
| ## Links |
| Paper: [arXiv](https://arxiv.org/abs/2606.21395) · [HuggingFace](https://huggingface.co/papers/2606.21395) · Code: [GitHub](https://github.com/learningmatter-mit/alm) |
|
|
| ## License |
| Apache-2.0. |
|
|
| ## Citation |
| ```bibtex |
| @article{edamadaka2026atomistic, |
| title = {Atomistic Language Models Understand and Generate Materials}, |
| author = {Edamadaka, Sathya and Ramesh, Krithik and Li, Ju and G\'omez-Bombarelli, Rafael}, |
| journal = {arXiv preprint arXiv:2606.21395}, |
| year = {2026} |
| } |
| ``` |
|
|
