You need to agree to share your Hugging Face information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

tymorton77/embeddinggemma-300m-mlx-4bit

Use with mlx

pip install mlx-lm

from mlx_lm import load, generate

model, tokenizer = load("tymorton77/embeddinggemma-300m-mlx-4bit")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True, return_dict=False,
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

Downloads last month: -

Safetensors

Model size

0.3B params

Tensor type

U32

F32

MLX

Hardware compatibility

4-bit