Instructions to use litert-community/LFM2.5-1.2B-Thinking with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT-LM
How to use litert-community/LFM2.5-1.2B-Thinking with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install -U litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli litert-lm run \ --from-huggingface-repo=litert-community/LFM2.5-1.2B-Thinking \ --prompt="Write me a poem"
- LiteRT
How to use litert-community/LFM2.5-1.2B-Thinking with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Card: multi-turn note updated for litert-lm 0.17.0 (past reasoning removed by the runtime; 3-turn results on the int8 file)
The multi-turn section of this card describes litert-lm 0.15.0, where past turns' <think> text stayed in the context; on 0.17.0 the runtime removes it before each turn, so the note is out of date for anyone reading the card now. This PR replaces that section with what the int8 file does on 0.17.0 in a 3-turn probe: with the default setting it answers the previous question at turn 3, with filter_channel_content_from_kv_cache off it drifts at turns 2 and 3, and the bf16 model passes with LiquidAI's own template, which keeps only the most recent turn's reasoning. The manifest's matching text is updated the same way. No model file changes; only the int8 file was re-run. If this does not fit the card, close it and I will carry it elsewhere. Thanks.
Links — the runs behind the table: https://github.com/google-ai-edge/LiteRT-LM/issues/3184 · the runtime release measured: https://github.com/google-ai-edge/litert-lm/releases/tag/v0.17.0