kerasformers/glm-4.1v-9b-thinking

Run GLM-4V with Keras 3: JAX, PyTorch, or TensorFlow

kerasformers/glm-4.1v-9b-thinking

Pure-Keras 3 conversion of zai-org/GLM-4.1V-9B-Thinking for kerasformers. One implementation runs unmodified on TensorFlow / Torch / JAX. GLM-4.1V-9B-Thinking is a vision-language model (GLM-4V vision tower + GLM-4 dense decoder) served as image + text -> text via Glm4vProcessor; weights are stored in bfloat16.

For model details, license, and usage terms, see the upstream model card.

Paper: GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning (arXiv:2507.01006) · HF Papers

✨ Quick start

import os
os.environ["KERAS_BACKEND"] = "torch"  # or "jax" / "tensorflow"

from PIL import Image
from kerasformers.models.glm4v import Glm4vConditionalGenerate, Glm4vProcessor

model = Glm4vConditionalGenerate.from_weights("kerasformers/glm-4.1v-9b-thinking")
processor = Glm4vProcessor.from_weights("kerasformers/glm-4.1v-9b-thinking")

inputs = processor(conversation=[
    {"role": "user", "content": [
        {"type": "image", "image": Image.open("photo.jpg")},
        {"type": "text", "text": "Describe this image in one sentence."},
    ]}
])
outputs = model.generate(**inputs, max_new_tokens=64)
print(processor.decode(outputs[0]))

Load any GLM variant the same way with from_weights("kerasformers/<variant>"). Browse them all in the GLM collection.

Special Thanks

A huge thank you to the Zhipu AI / THUDM team for creating and releasing the GLM models.

License: mit (per the upstream model card).