moondream-eduport is a full-parameter finetuned version of moondream2, a small vision language model designed to run efficiently on edge devices.

Usage

pip install transformers einops
from transformers import AutoModelForCausalLM, AutoTokenizer
from PIL import Image

model_id = "aoxo/moondream-eduport"
revision = "2024-08-26"
model = AutoModelForCausalLM.from_pretrained(
    model_id, trust_remote_code=True, revision=revision
)
tokenizer = AutoTokenizer.from_pretrained(model_id, revision=revision)

image = Image.open('<IMAGE_PATH>')
enc_image = model.encode_image(image)
print(model.answer_question(enc_image, "Describe this image.", tokenizer))

The model is updated regularly, so we recommend pinning the model version to a specific release as shown above.

Downloads last month
31
Safetensors
Model size
1.87B params
Tensor type
FP16
·
Inference API
Unable to determine this model's library. Check the docs .