Attention Became Efficient and Scalable: KV Caching, MQA, GQA, MLA, and DSA

1 points | by ibobev 7 hours ago