xformAI/facebook-opt-125m-qcqa-ub-6-best-for-KV-cache Text Generation • Updated Jan 23, 2024 • 62 • 1
Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning Paper • 2609.03430 • Published 8 days ago • 177
Rethinking On-Policy Distillation of Large Language Models II: One Training Example Paper • 2609.04172 • Published 8 days ago • 91