Kimi Linear: An Expressive, Efficient Attention Architecture Overview and a Link

It is heartwarming to see how architectural choices like KDA and NoPE translate into such strong real-world performance. Really impressive engineering.