Your LR Schedule May Not Be Principled: Effective Learning Rate Scheduling in Weight-Normalized Training
Paper • 2610.40362 • Published • 11
David Flores
DF6
AI & ML interests
None yet
Recent Activity
upvoted a paper 20 days ago
Learning Multimodal Embeddings with Evidence-Aligned ReadoutOrganizations
None yet
upvoted a paper 8 days ago
upvoted 6
papers 20 days ago
Learning Multimodal Embeddings with Evidence-Aligned Readout
Paper • 2609.33659 • Published • 11
What Really Works for Universal Multimodal Embeddings? A Controlled Study of Contrastive Training Strategies
Paper • 2610.15035 • Published • 14
Learning to Read Out: Unembedding Dynamics in Language Model Pretraining
Paper • 2610.21025 • Published • 6
Beyond Policy Rollouts: Embedding-Space Directional Exploration with Anchored Noise for LLM RLVR
Paper • 2610.16105 • Published • 13
SpecMRL: Redesign Matryoshka Representation Learning within Parametric Spectrum
Paper • 2610.26824 • Published • 33
Embeddings Are Overpriced? A Frozen 16 MB Vocabulary for Small and Ternary Language Models
Paper • 2610.22428 • Published • 11
upvoted a paper about 1 month ago
upvoted a paper 5 months ago
upvoted a paper 9 months ago