When Fancy Eviction Fails: Rethinking Cache Replacement for LLM Prefix Reuse

1 points | by matt_d 11 hours ago