Instructions to use kasimtmc/embeddinggemma-litertlm with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT-LM
How to use kasimtmc/embeddinggemma-litertlm with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install -U litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli litert-lm run \ --from-huggingface-repo=kasimtmc/embeddinggemma-litertlm \ --prompt="Write me a poem"
- Notebooks
- Google Colab
- Kaggle
EmbeddingGemma-300M β LiteRT-LM package
.litertlm build of google/embeddinggemma-300m
for the LiteRT-LM EmbeddingEngine (v0.17.0+),
used by the Ruminote app for on-device semantic search / RAG.
- embeddinggemma_300m.litertlm β dynamic int8, 768-dim output (MRL truncation available at
runtime via
EmbeddingOptions.outputSize), sequence buckets 64/128/256/512. - Structure: split litert-torch export β
embedder(token β embedding) +text_encoder(sequence β pooled vector) + SentencePiece tokenizer + embedding metadata, packed withlitert-lm pack. The split pipeline is verified bit-exact against the original model. - Query prefix:
task: search result | query: {text}Β· document prefix:title: none | text: {text}(per the EmbeddingGemma model card).
License
Gemma is provided under and subject to the Gemma Terms of Use. By downloading this model you agree to those terms, including the Gemma Prohibited Use Policy. This repository redistributes a converted (quantized, repackaged) derivative of google/embeddinggemma-300m; all rights in the underlying model remain with Google.
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. π Ask for provider support
Model tree for kasimtmc/embeddinggemma-litertlm
Base model
google/embeddinggemma-300m