智能AI
None
LKV:Head-wise 预算的端到端学习和 LLM KV 缓存驱逐的令牌选择
06676v1 Announce Type: new Abstract: Long-context inference in Large Language Models (LLMs) is bottlenecked by the linea
2026-05-11
Enshuai Zhou, Yifan Hao, Chao Wang, Rui Zhang, Di Huang, Jiaming Guo, Xing Hu, Zidong Du, Qi Guo, Yunji Chen