Homogeneous Keys, Heterogeneous Values: Exploiting Local KV Cache Asymmetry for Long-Context LLMs · HackerPapers discussions

Homogeneous Keys, Heterogeneous Values: Exploiting Local KV Cache Asymmetry for Long-Context LLMs — mentioned by yorwba

Mon, 06 Oct 2025 17:36:26 GMT

Yes, for example https://arxiv.org/pdf/2506.05410 merges two neighboring tokens with the lowest sum of past attention scores, and this method would enable using future expected attention instead.

Paper and discussion history. A mention is not an endorsement.

Homogeneous Keys, Heterogeneous Values: Exploiting Local KV Cache Asymmetry for Long-Context LLMs — HN submission

Fri, 27 Jun 2025 15:22:27 GMT

Exploiting Local KV Cache Asymmetry for Long-Context LLMs

6 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.