EnvACE-Qwen3-1.7B

Model Description

EnvACE-Qwen3-1.7B is a tool-interactive agent model based on Qwen/Qwen3-1.7B (Thinking Mode), trained with the EnvACE framework for long-horizon tool use. Instead of interacting with real or synthesized executable environments during training, the model is trained by world rehearsal: it internalizes environment dynamics in its own parameters and acts as its own environment.

Training Process

EnvACE replaces external environment interaction with world rehearsal inside a single policy:

  • Acting / rehearsal alternation: the policy first generates a tool call, then plays the role of the environment to produce the response induced by that action, and conditions its subsequent decisions on the rehearsed response.
  • Joint end-to-end optimization: both roles share one set of parameters and are trained together with role-wise GRPO (a separate advantage baseline per role, one shared policy) from task-success rewards only — a pure RL stage, with no external simulator or executable environment in the loop.
  • Agent world model: through rehearsal the policy internalizes the relationship between actions and environment responses, yielding a world model that directly supports decision making. At test time this enables private rehearsal before committed execution, giving further gains under a moderate rehearsal budget without additional external interaction.

The method is evaluated on BFCL-v4, τ²-Bench, VitaBench and FinMCP-Bench, where it shows strong and transferable performance against environment-scaling baselines; controlled studies show world rehearsal consistently improves policy learning across model scales. See the paper for full results.

How to Use

Basic Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "Team-ACE/EnvACE-Qwen3-1.7B"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)

# Qwen3 chat template + native function-calling format:
# tokenizer.apply_chat_template(messages, tools=tools, add_generation_prompt=True)

Recommended sampling parameters (inherited from Qwen3): temperature=0.6, top_p=0.95, top_k=20.

With the EnvACE Framework

For training and for full integration with tool-interactive environments, see the EnvACE repository.

Related Resources

Citation

If you use this model, please cite our work:

@article{xu2026envace,
  title={EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning},
  author={Xu, Zishan and Yao, Zhiyuan and Chen, Yuxin and Guo, Yifu and Lu, Zhengxi and Lu, Yuquan and Huang, Jinyang and Xu, Yan and Wang, Yasheng and Zhang, Weinan and Zeng, Xingshan and Liu, Weiwen},
  journal={arXiv preprint arXiv:2608.06197},
  year={2026}
}

License

This model is licensed under the Apache 2.0 License, following the base Qwen3 model license.

Downloads last month
19
Safetensors
Model size
2B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Team-ACE/EnvACE-Qwen3-1.7B

Finetuned
Qwen/Qwen3-1.7B
Finetuned
(1085)
this model

Collection including Team-ACE/EnvACE-Qwen3-1.7B

Paper for Team-ACE/EnvACE-Qwen3-1.7B