kerasformers/glm-4.5-air-base

Run GLM-4.5 with Keras 3: JAX, PyTorch, or TensorFlow

kerasformers/glm-4.5-air-base

Pure-Keras 3 conversion of zai-org/GLM-4.5-Air-Base for kerasformers. One implementation runs unmodified on TensorFlow / Torch / JAX. This is the GLM-4.5-Air-Base mixture-of-experts checkpoint served as text -> text; weights are stored in bfloat16, with the mixture-of-experts router correction bias kept in float32 (matching the upstream mixed-precision checkpoint). See kf_config.json (weight_dtype + weight_dtype_overrides) for the exact layout.

For model details, license, and usage terms, see the upstream model card.

Paper: ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools (arXiv:2406.12793) · HF Papers

✨ Quick start

import os
os.environ["KERAS_BACKEND"] = "torch"  # or "jax" / "tensorflow"

from kerasformers.models.glm4_moe import Glm4MoeTextGenerate, Glm4MoeTokenizer

model = Glm4MoeTextGenerate.from_weights("kerasformers/glm-4.5-air-base")
tokenizer = Glm4MoeTokenizer.from_weights("kerasformers/glm-4.5-air-base")

messages = [{"role": "user", "content": "Name three prime numbers."}]
inputs = tokenizer(messages)
outputs = model.generate(**inputs, max_new_tokens=128)
print(tokenizer.decode(outputs[0]))

Load any GLM variant the same way with from_weights("kerasformers/<variant>"). Browse them all in the GLM collection.

Special Thanks

A huge thank you to the Zhipu AI / THUDM team for creating and releasing the GLM models.

License: mit (per the upstream model card).