From Muon to Gradient Clipping: Some Thoughts on QK Stability

3 points | by Eridanus2 21 hours ago