JEPA-TTT: Persistent Test-Time Training of Latent World Models for Planning under Dynamics Shifts
Abstract
World models enable agents to plan by predicting future states of the environment, but their predictions can become unreliable when test-time dynamics differ from those seen during training. We present JEPA-TTT, which adapts the latent dynamics predictor of a pretrained action-conditioned Joint-Embedding Predictive Architecture world model throughout test time. Self-supervised updates accumulate across episodes, while the visual encoder and reward head remain fixed, preserving the pretrained representation and task objective. Planning requires neither a goal image nor online environment reward. JEPA-TTT uses dense replay, which forms prediction windows at every temporal offset, retains them in a growing buffer, and samples minibatches from that buffer for predictor updates. Across eight dynamics shifts in four continuous-control environments, JEPA-TTT improves planning on every shift. After 500 test-time episodes, it reduces autoregressive latent prediction error by 83% on average and improves planning performance by 153% over the frozen JEPA world model. These results show that persistent self-supervised test-time training can adapt a pretrained latent world model under changed dynamics.
Community
A pretrained latent world model's predictions can become unreliable when test-time dynamics differ from training. Introducing JEPA-TTT, which enables persistent test-time training of latent world models for planning under dynamics shifts.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Sandwich-Residuals: Parameter-Efficient Test-time Adaptation of World Models (2026)
- FlexiWorld: Learning and Planning via Flexible Action Chunks Across Multiple Time Scales (2026)
- LePlanner: An Iterative Amortized Controller For World Models (2026)
- FIRM-WM: State-factorized factual-interventional recurrent modeling for reward-free visual planning (2026)
- No Gaussian Required: Contrastive Inverse Dynamics for JEPA World Models (2026)
- LRC-JEPA: Disentangling Dynamics and Residual Context for Efficient World Models (2026)
- DeepJEPA: Scaling World Models from Within (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper