Thinking Machines dropped RoPE, and it's a good idea

5 points | by smaddrellmander 11 hours ago