← yilin-vaultwriting/

Blog

Kimi K3: Staying the Course on Linear Attention

The story of KDA is not just about scaling linear attention. It is about choosing a technical direction, betting on it, and staying with it long enough to make it work at 2.8T parameters.

Loop Engineering, and Why a New "X Engineering" Keeps Showing Up

What loop engineering actually is, how to build a good loop, and why a new "X engineering" keeps appearing every few months.