Sinhala MMLU: LoRA adapter + choice head
LoRA adapter (rank 32, all 24 kept layers) for
Lalaa-a/gemma4-8b-text-only (text weights of
google/gemma-4-E4B-it) cut after layer 24, plus head.pt: a small transformer choice head that scores each
option from Gemma's hidden states. Not usable with plain AutoModelForCausalLM: load it with the team's
inference.py (main repository), which rebuilds the cut model from meta.json.
| File | What |
|---|---|
lora/ |
PEFT adapter (adapter_config.json, adapter_model.safetensors) |
head.pt |
choice head weights (PyTorch state dict) |
meta.json |
how to rebuild the network: layer cut, head size, token limits, readout |
config.yaml |
the full training config of this checkpoint |
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support