Qwen3.8-27B latent attention retrofits
Collection
Training-free MLA / GLA retrofits of Qwen3.8-27B with a 2x smaller KV cache. Weights preview; vLLM plugin, quants and code coming early October 2026. • 8 items • Updated
QKV768
QKV768
P(doom) 10%
AI & ML interests
Interested in attention. Working on attention retrofits, and novel attention mechanisms. My discord: noot.auger
Recent Activity
updated a collection 7 days ago
Qwen3.8-27B latent attention retrofits updated a collection 7 days ago
Qwen3.8-27B latent attention retrofits updated a collection 7 days ago
Qwen3.8-27B latent attention retrofitsOrganizations
updated a
collection 7 days ago
updated a
model 7 days ago
published a
model 7 days ago
updated a
model 7 days ago
published a
model 7 days ago
updated a
model 7 days ago
published a
model 7 days ago
updated a
model 7 days ago
published a
model 7 days ago
updated 4
models 7 days ago
upvoted a changelog 8 days ago
Hugging Face Changelog
P(doom) on user profiles
• 351
updated a
collection 9 days ago
published a
model 9 days ago