LLMs Know What to Drop: Self-Attention Guided KV Cache Eviction for Efficient Long-Context Inference

Published in ICLR 2025 Workshop on Sparsity in LLMs (SLLM), 2025