sergiopaniego/openenv-sudoku-runs-bucket
117 MB
Sergio Paniego PRO
sergiopaniego
AI & ML interests
None yet
Recent Activity
updated a model about 1 hour ago
sergiopaniego/Qwen3-1.7B-Sudoku-SFT-GRPO updated a dataset about 2 hours ago
agents-course/certificates updated a dataset about 3 hours ago
agents-course/final-certificatesOrganizations
Posts 121
Post
506
Mistral Large 4 (Le Chonk 🐈) is now live on the Hub and you can post-train it with TRL today!
SFT + LoRA example ready, runs on a single 8xB300 node
> model: mistralai/Mistral-Large-4-1T-A52B
> TRL example: https://github.com/huggingface/trl/tree/main/examples/sft_mistral_large_4
> blog: https://huggingface.co/blog/mistral-large4
SFT + LoRA example ready, runs on a single 8xB300 node
> model: mistralai/Mistral-Large-4-1T-A52B
> TRL example: https://github.com/huggingface/trl/tree/main/examples/sft_mistral_large_4
> blog: https://huggingface.co/blog/mistral-large4
Slides from my talks
-
Building AI in the open (UC3M)
🤗Watch a talk on building AI in the open
-
Train the agent slides
🤖17Watch a talk on modern agent training techniques
-
Train the agent slides (PyTorch Madrid)
🤖Watch a talk on modern agent training techniques
-
Multi-harness RL slides
🎛11Watch a tutorial on training coding agents with RL environments
Slides from my talks
-
Building AI in the open (UC3M)
🤗Watch a talk on building AI in the open
-
Train the agent slides
🤖17Watch a talk on modern agent training techniques
-
Train the agent slides (PyTorch Madrid)
🤖Watch a talk on modern agent training techniques
-
Multi-harness RL slides
🎛11Watch a tutorial on training coding agents with RL environments
Training Agents Class 3 (GRPO): the training scripts, the Trackio dashboard and the task data.
spaces 200
pinned
Running on Zero
Agents
Featured
126
VLM Object Understanding
🦀
Explore object detection, visual grounding, keypoint Detecti
pinned
Runtime error
Agents
11
Qwen2-VL-7B
🔥
Ask questions about charts in images
pinned
Running on Zero
Agents
SmolVLM-trl-dpo-rlaif-v
🔥
Generate text from an image and question
pinned
Runtime error
Agents
SmolVLM-trl-sft-ChartQA
🔥
Ask questions about charts in images
Running
Openenv Sudoku Static 70bb5a
🎯
View and monitor your data in an interactive dashboard
Running
Agents
Openenv Sudoku Runs
🎯
Show visual tracking data with a single command
models 143
sergiopaniego/Qwen3-1.7B-Sudoku-SFT-GRPO
Text Generation • 2B • Updated
sergiopaniego/Qwen3-1.7B-Sudoku-SFT
Text Generation • 2B • Updated • 21
sergiopaniego/qwen3-1.7b-mbpp-grpo
Text Generation • 2B • Updated • 78
sergiopaniego/rl-envs-youtube-livestream-4-scripts
Updated
sergiopaniego/qwen3-1.7b-wordle-grpo
Text Generation • 2B • Updated • 29
sergiopaniego/Qwen3-4B-claude-code-local-grpo
Text Generation • 4B • Updated • 15
sergiopaniego/Qwen3-4B-claude-code-deepcoder-grpo
Text Generation • 4B • Updated • 17
sergiopaniego/pelican-svg-grpo-Qwen3-1.7B-judged
Text Generation • 2B • Updated • 32
sergiopaniego/pelican-svg-grpo-Qwen3-1.7B
Text Generation • 2B • Updated • 12
sergiopaniego/Qwen3-8B-opencode-deepcoder-grpo
Text Generation • 8B • Updated • 33 • 1
datasets 17
sergiopaniego/sudoku-tool-calls-sft
Viewer • Updated • 1k • 20
sergiopaniego/opencode-rollout-trace
Updated • 947
sergiopaniego/pelican-svg-drawings
Viewer • Updated • 169 • 606 • 1
sergiopaniego/math-sdpo-hints-plain
Viewer • Updated • 600 • 36
sergiopaniego/math-sdpo-hints
Viewer • Updated • 600 • 17
sergiopaniego/gsm8k-sdpo-plain
Viewer • Updated • 700 • 13
sergiopaniego/gsm8k-sdpo-hints
Viewer • Updated • 700 • 15
sergiopaniego/pi-mono-chat
Viewer • Updated • 886 • 28
sergiopaniego/requests-pr-diff
Viewer • Updated • 1 • 257
sergiopaniego/trl-r2e-test
Viewer • Updated • 1 • 57