A Self-Pruning Transformer: Extreme KV-Cache Compression w/Universal Attention

6 points | by matt_d 11 hours ago