Axion 1.0: Open Agent Foundation Models, Simplified
Abstract
Axion 1.0 is an open agent foundation model trained via a concise three-stage pipeline of supervised fine-tuning and reinforcement learning, achieving competitive agentic performance while fully releasing its data and training recipe.
We introduce Axion 1.0, a fully open agent foundation model that combines strong and broad agentic capabilities with a remarkably simple training recipe. Axion 1.0 is trained in only three stages: two lightweight supervised fine-tuning stages followed by reinforcement learning, without dedicated mid-training, direct preference optimization (DPO), or on-policy distillation (OPD). The first SFT stage develops strong self-contained reasoning through model-aware data construction, where we synthesize challenging problems and adversarially strengthen them based on the base model's own successful solution strategies. The second stage extends these capabilities to tool-dependent reasoning through a scalable pipeline for constructing diverse and automatically verifiable tasks grounded in real-world data sources and deterministic computation. Finally, reinforcement learning further strengthens long-horizon reasoning and interaction with external tools and environments. Despite this compact training recipe, Axion 1.0 achieves strong performance across a broad suite of agentic benchmarks and is competitive with leading commercial models on several of them. Equally importantly, Axion 1.0 is open beyond model weights: we release the complete recipe, including data construction, generation, filtering, verification, prompts, and training code, enabling the entire development process to be reproduced and extended. Axion 1.0 demonstrates that strong agent foundation models can be both open and simple, offering a practical and reproducible path toward advancing open agentic intelligence.
Community
Introducing Axion 1.0: Open Agent Foundation Models, Simplified.
Strong scientific reasoning and tool use with a simple post-training recipe: two lightweight supervised fine-tuning stages followed by reinforcement learning.
- Learn to reason: model-aware construction of challenging, self-contained scientific problems.
- Learn to investigate: verifiable tasks that require retrieving information and using tools.
- Learn through interaction: reinforcement learning over agent trajectories.
With approximately 18K SFT examples, Axion 1.0-35B and 122B achieve competitive results across six evaluation settings: HLE, BioMysteryBench, SEAL-0, HiPhO, and the Olympiad and Research splits of FrontierScience.
The Axion 1.0-35B reproduction checkpoint is now available under Apache 2.0. It scores 52.8 on HLE, 35.3 on BioMysteryBench, 60.4 on SEAL-0, 45.9 on HiPhO, 85.0 on FrontierScience Olympiad, and 55.0 on FrontierScience Research.
Paper: https://arxiv.org/abs/2611.03233
Project: https://axion1-0.github.io/
Code: https://github.com/bytedance/axion1_0
Training data: https://huggingface.co/datasets/Axion1-0/axion-training-data
Model (35B reproduction): https://huggingface.co/Axion1-0/Axion-1.0-35B
Really nice to see the full recipe released alongside the weights, including data construction, prompts and training code. The chained partial credit in the RL reward (a later intermediate target only counts once all its prerequisites are verified, capped at 0.3 for a wrong final answer) looks like a sensible way to reward progress without making it easy to game. Curious about the RL task filter: since a question is kept only if at least one of four rollouts is correct and the rewards have nonzero variance, roughly what fraction of the programmatic pool survives at the 35B-A3B scale? And do you expect the 4B and 9B SFT-only variants to gain as much from the same GRPO stage?
Get this paper in your agent:
hf papers read 2611.03233 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 1
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper