f in x
Alibaba trains AI models to predict environments instead of acting and beats seven benchmarks
> cd .. / HUB_EDITORIALE
News

Alibaba trains AI models to predict environments instead of acting and beats seven benchmarks

[2026-06-25] Author: Meteora Web

Alibaba's Qwen team has released Qwen-AgentWorld, two AI models that are not trained to act within agent environments but to predict what those environments will return. This world modeling approach has allowed the models to beat seven agent benchmarks, including three never seen during training. The models, based on Mixture-of-Experts architecture, cover seven domains: MCP, Search, Terminal, Software Engineering, Android, Web, and OS.

A paradigm shift in agent training

Most agent models are trained to answer one question: given what the environment just showed, what action should I take next? Qwen-AgentWorld is trained to answer the inverse: given what the agent just did, what will the environment show next? This reversal is the core of what the paper calls a language world model. Instead of optimizing for action selection, the model learns to predict the next environment state across all seven domains under a single training objective. Prior work was narrower: WebWorld covered only web environments, and Snowflake's Agent World Model generated code-driven environments. Qwen-AgentWorld is the first to span seven domains in a single model with environment modeling baked in from the earliest pretraining stage.

Sponsored Protocol

Training on over 10 million trajectories in three stages

Alibaba trained both models in three stages on more than 10 million environment interaction trajectories from real agent runs. Stage one teaches the model how environments behave: file systems, terminal states, browser DOM changes, and API responses. Stage two trains the model to reason through what comes next before predicting it. Stage three uses reinforcement learning to tighten predictions through rule-based checks and open-ended quality scoring. Both models are Mixture-of-Experts designs: only a fraction of parameters are active per token. The 35B model activates 3B parameters, while the 397B activates 17B. Both support 256K context windows. For GUI domains (Android, Web, and OS), the models work from textual accessibility trees and UI view hierarchies rather than screenshots.

Sponsored Protocol

Training results surpass real-environment performance

According to the researchers, agents trained inside controlled simulation outperformed agents trained in real environments. Injecting targeted perturbations — partial responses that force extra agent steps and edge cases real environments rarely surface — pushed MCPMark from 24.6 to 33.8. On Search, agents trained in entirely fictional worlds transferred to real search tasks, pushing WideSearch F1 Item from 34.02 to 50.31 on the open 35B model. A separate warm-up test showed that world model pretraining improved BFCL v4 from 62.29 to 71.25 and Claw-Eval from 53.60 to 64.88 with no agent-specific fine-tuning. These results suggest that synthetic environment training can be a powerful complement to real-environment RL, similar to how other AI companies are investing in medical research, such as Stripe, Anthropic, and OpenAI funding the fight against the common cold. To understand the fundamentals of this technique, one can refer to Wikipedia's page on reinforcement learning.

Sponsored Protocol

The researchers acknowledged the need for verification. The AgentWorldBench benchmark, created by the same team, saw a margin of improvement of 0.46 points, raising concerns about overfitting. However, the fictional-world Search result provides strong evidence against reliance solely on simulation. The controlled Sim-RL methodology indicates that gains depend on the ability to inject extreme conditions, not just simulation accuracy. For teams building agent pipelines, this research opens the door to a new training layer: controlled synthetic environments that expose edge cases production cannot generate.

Sponsored Protocol

Implications for AI engineering teams

For AI engineering teams building and scaling agent pipelines, Alibaba's work signals a meaningful shift. There is now a third option between real-environment RL and static benchmarks: controlled simulation that injects edge cases. Pretraining on world models can precede agent specialization, boosting performance even without agent-specific fine-tuning. This suggests that environment grounding should be integrated earlier in the development process, changing current practices for many teams.

Source: https://venturebeat.com/technology/alibabas-model-never-trained-as-an-agent-and-improved-agent-performance-across-seven-benchmarks

Meteora Web

> AUTHOR_EXTRACTED

Meteora Web

[ Read Full Dossier ]

> METEORA_WEB // DIGITAL AGENCY

We build the digital presence your business deserves.

Websites, social media, online advertising, e-commerce and high-performance hosting, engineered with method by computer engineers in Sciacca, for all of Italy.

> MW_JOURNAL

> READ_ALL()