SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models
Paper • 2609.02886 • Published • 144
Asuka Shiori
Asukori
·
AI & ML interests
None yet
Recent Activity
upvoted a paper 5 days ago
SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models upvoted a paper about 1 month ago
Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents reacted to sergiopaniego's post with 👍 2 months ago
Frontier models use distillation as a step of their post-training pipelines.
In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.
I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026
It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL! Organizations
None yet
upvoted a paper 5 days ago
upvoted a paper about 1 month ago
reacted to sergiopaniego's post with 👍 2 months ago
Post
7800
Frontier models use distillation as a step of their post-training pipelines.
In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.
I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026
It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL!
In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.
I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026
It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL!
- 3 replies
upvoted 2
papers 2 months ago
upvoted a paper 4 months ago
upvoted an article 4 months ago
Article
How 🤗 Accelerate runs very large models thanks to PyTorch
sgugger
• • 18 updated a
Space over 2 years ago