Massive Activations in Hybrid Linear Attention Models
Collection
Official PAS, ISP, gating-ablation, and scale-study checkpoints for Massive Activations in Hybrid Linear Attention Models. • 10 items • Updated • 2
zunhaisu
zunhai
AI & ML interests
None yet
Recent Activity
upvoted a collection 1 day ago
Massive Activations in Hybrid Linear Attention Models upvoted a paper 10 days ago
LEGO-RL: Harness-Native Reinforcement Learning for Coding Agents upvoted a collection 10 days ago
Lego-RLOrganizations
upvoted a collection 1 day ago
upvoted a paper 10 days ago
upvoted a collection 10 days ago
upvoted a paper 13 days ago
authored 3
papers 16 days ago
Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus
Paper • 2608.12149 • Published • 30
SnapMLA: Efficient Long-Context MLA Decoding via Hardware-Aware FP8 Quantized Pipelining
Paper • 2602.10718 • Published
XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compression
Paper • 2601.01204 • Published
submitted a
paper to Daily Papers 16 days ago
updated a
model 17 days ago
updated a
collection 17 days ago
updated a
model 17 days ago