Speedrun architecture: 8 pretraining seeds/size, anneal marks every 10 TPP as revisions. Plain ladder: “Scaling Ladder — 4 sizes, 135M–973M, 200 TPP”
Julian Minder
jkminder
AI & ML interests
None yet
Recent Activity
updated a model 21 days ago
jkminder/pretraining-priors-doormail4k-d32-treated-base published a model 21 days ago
jkminder/pretraining-priors-doormail4k-d32-treated-base updated a model 28 days ago
jkminder/d20_477m_seed4_sftOrganizations
Scaling Ladder (optimized) — 3 sizes, 286M–897M, 200 TPP
Speedrun architecture: 8 pretraining seeds/size, anneal marks every 10 TPP as revisions. Plain ladder: “Scaling Ladder — 4 sizes, 135M–973M, 200 TPP”
Scaling Ladder — 4 sizes, 135M–973M, 200 TPP
The whole ladder, 200 TPP on ClimbMix; plain GPT (nanochat mechanisms disabled). Bases, then chat-SFTs (_sft).
models 177
jkminder/pretraining-priors-doormail4k-d32-treated-base
Text Generation • 2B • Updated • 195
jkminder/d20_477m_seed4_sft
Text Generation • 0.5B • Updated • 296
jkminder/d20_477m_seed3_sft
Text Generation • 0.5B • Updated • 313
jkminder/d20_477m_seed1_sft
Text Generation • 0.5B • Updated • 337
jkminder/d20_477m_seed2_sft
Text Generation • 0.5B • Updated • 367
jkminder/d26_973m_seed4_sft
Text Generation • 1.0B • Updated • 376
jkminder/d26_973m_seed3_sft
Text Generation • 1.0B • Updated • 354
jkminder/d26_973m_seed1_sft
Text Generation • 1.0B • Updated • 328
jkminder/d26_973m_seed2_sft
Text Generation • 1.0B • Updated • 339
jkminder/d12_135m_seed4_sft
Text Generation • 0.1B • Updated • 403
datasets 15
jkminder/pretraining-priors-pirate-register
Viewer • Updated • 999k • 151
jkminder/normative-reflections-feedback
Viewer • Updated • 5 • 8
jkminder/apertus-annotation-feedback
Viewer • Updated • 52 • 61
jkminder/model-raising-interp-prepared
Viewer • Updated • 100k • 17
jkminder/model-raising-pbsft-eval
Viewer • Updated • 9.99k • 14
jkminder/model-raising-reflection-end-eval
Viewer • Updated • 28.7k • 28
jkminder/model-raising-pb-300k-3c-sft
Viewer • Updated • 302k • 18
jkminder/or-bench-1k-overrefusal
Viewer • Updated • 962 • 42
jkminder/xstest-overrefusal
Viewer • Updated • 214 • 51
jkminder/orfuzz
Viewer • Updated • 1.79k • 10