When the KV Cache Is Slower Than the GPU: Scaling Remote KV Tiers

2 points | by wondersky 7 hours ago