agenttune-agent-ops-GRPO

Built using AgentTune — agentic workflows, then train / evaluate / distill / self-heal through one trajectory schema.


Finetuned from	Qwen/Qwen3.5-4B
Algorithm	grpo
Backend	trl
Artifact	adapter
Published	2026-09-10 20:25 UTC

Usage

from peft import AutoPeftModelForCausalLM
from transformers import AutoTokenizer

model = AutoPeftModelForCausalLM.from_pretrained("ram-lexsi/agenttune-agent-ops-GRPO")
tokenizer = AutoTokenizer.from_pretrained("ram-lexsi/agenttune-agent-ops-GRPO")

This repo is a LoRA adapter. Load it on top of Qwen/Qwen3.5-4B (PEFT does that from adapter_config.json).

Community: Lexsi Discord

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ram-lexsi/agenttune-agent-ops-GRPO

Base model

Qwen/Qwen3.5-4B-Base

Finetuned

Qwen/Qwen3.5-4B

Finetuned

(975)

this model